Skip to main content

Advances, Systems and Applications

Table 1 The inference latency of different types of network structures on GPU and CPU

From: RDPNet: a single-path lightweight CNN with re-parameterization for CPU-type edge devices

Model

Param(M)

FLOPs(G)

CUDA(ms)

CPU(ms)

VGG16

138

15.5

467.0

122.78

Resnet18

11.7

1.8

22.29

65.58

Resnet50

25.6

4.1

85.55

107.67

MobilenetV3-small

3.6

0.1

20.31

30.43

Mobilenetv2-1x

3.5

0.3

38.29

45.62

Shufflunetv2-1.5x

3.5

0.3

28.31

36.05

RepVGG-A0

7.0

1.4

4.83

52.34

RDPNet-1.0x

1.3

0.3

12.45

23.14