Skip to main content

Advances, Systems and Applications

Table 7 Heterogeneous stream I-DAG workflow Stage0→1

From: IoT-enabled directed acyclic graph in spark cluster

Event

Query type

Source file

Flat map

Map

Reduce

Core %

DISK (GB)

I-DAG

Error

Simple

2.3 sec

20 sec

Bypassed

29 sec

21.2%

0.0002%

2-node

Backup

Simple

3.8 sec

28 sec

25 sec

31 sec

22.9%

0.0008%

3-node

Informaton

Simple

1.9 sec

15 sec

Bypassed

21 sec

19.3%

0.0003%

2-node

Error

Compound

18 sec

41 sec

10 sec

49 sec

23.3%

0.0004%

3-node

Backup

Compound

22 sec

39 sec

Bypassed

41 sec

18.71%

0.0003%

2-node

Information

Compound

16 sec

37 sec

Bypassed

39 sec

20.66%

0.0008%

2-node

Error

Range

35 sec

12 sec

19 sec

37 sec

21.97%

0.0008%

3-node

Backup

Range

42 sec

29 sec

Bypassed

43 sec

19.38%

0.0009%

2-node

Information

Range

28 sec

11 sec

22 sec

41 sec

21.26%

0.0007%

3-node

Error

String

17 sec

15 sec

Bypassed

29 sec

22.3%

0.0009%

2-node

Backup

String

16 sec

18 sec

31 sec

38 sec

20.61%

0.0004%

3-node

Information

String

18 sec

13 sec

43 sec

39 sec

19.52%

0.0003%

3-node