Skip to main content

Advances, Systems and Applications

Table 8 Heterogeneous stream I-DAG workflow Stage0→n

From: IoT-enabled directed acyclic graph in spark cluster

Event

Query

Source

Map

Partition

Value

GroupBy

Join

Equal

Reduce

Core%

DISK-GB

I-DAG

Error

Simple

4.9 sec

25 sec

38 sec

62 sec

Bypassed

22 sec

Yes

63 sec

30.5%

0.0009%

5-node

Backup

Simple

8.3 sec

32 sec

Bypassed

87 sec

58 sec

Bypassed

Yes

58 sec

29.7%

0.009%

4-node

Informaton

Simple

7.6 sec

26 sec

47 sec

Bypassed

43 sec

12 sec

Yes

46 sec

28.64%

0.0006%

4-node

Error

Compound

63 sec

68 sec

Bypassed

49 sec

38 sec

Bypassed

Yes

86 sec

31.75%

0.0009%

4-node

Backup

Compound

48 sec

75 sec

48 sec

Bypassed

59 sec

18 sec

Yes

63 sec

32.41%

0.0009%

5-node

Information

Compound

71 sec

81 sec

52 sec

46 sec

Bypassed

31 sec

Yes

75 sec

29.63%

0.0008%

5-node

Error

Range

85 sec

49 sec

Bypassed

71 sec

51 sec

Bypassed

Yes

67 sec

30.76%

0.0008%

4-node

Backup

Range

76 sec

57 sec

63 sec

Bypassed

78 sec

37 sec

Yes

82 sec

29.66%

0.0009%

5-node

Information

Range

84 sec

64 sec

Bypassed

69 sec

83 sec

Bypassed

Yes

59 sec

31.69%

0.0006%

4-node

Error

String

74 sec

46 sec

59 sec

Bypassed

48 sec

18 sec

Yes

71 sec

29.48%

0.0008%

5-node

Backup

String

69 sec

39 sec

Bypassed

41 sec

88 sec

34 sec

Yes

68 sec

30.53%

0.0007%

5-node

Information

String

82 sec

51 sec

61 sec

Bypassed

49 sec

71 sec

Yes

84 sec

29.83%

0.0007%

5-node