Benchmark of Model Performance

Descriptions

  • Test Conditions:

    • Test Board: J6E.

    • Number of Test Cores: Single core.

    • Frequency to obtain model performance data: Average of performance parameters over a 5-minute period.

    • Python version: Python 3.10.

    • Models: Models under the samples/ucp_tutorial/dnn/ai_benchmark/j6 path in the OE package.

    • Runtime Environment: Linux.

  • Table Header Acronyms:

    • C = Computation, in GOPs (i.e., billion operations per second), obtained by calling the hbm_perf interface.

    • FPS = Frame(s) Per Second, obtained by running the fps.sh script with multi thread of different models in the ai_benchmark sample package/script on the dev board. Post-processing included.

    • ITC = Inference Time Consumption, in ms (millisecond), obtained by running the latency.sh script with single thread of different models in the ai_benchmark sample package/script on the dev board. Post-processing not included.

    • TCPP = Postprocess Time Consumption, in ms (millisecond), obtained by running the latency.sh script with single thread of different models in the ai_benchmark sample package/script on the dev board.

    • RV = Read Volume in a single inference, in mb (Mbit), obtained by calling the hbm_perf interface.

    • WV = Write Volume in a single inference, in mb (Mbit), obtained by calling the hbm_perf interface.

Model Key Performance Data

MODEL NAMEINPUT SIZEC(GOPs)FPSITC(ms)TCPP(ms)ACCURACYDataset
MobileNetv1

1x3x224x224

1.144249.800.5270.034

Top1:

0.7373(FLOAT)/0.7295(INT8)

ImageNet
MobileNetv2

1x3x224x224

0.634272.400.5440.034

Top1:

0.7217(FLOAT)/0.7146(INT8)

ImageNet
ResNet50

1x3x224x224

7.721155.201.2170.034

Top1:

0.7703(FLOAT)/0.7673(INT8)

ImageNet
GoogleNet

1x3x224x224

3.002861.300.6930.033

Top1:

0.7018(FLOAT)/0.6998(INT8)

ImageNet
EfficientNet_Lite0

1x224x224x3

0.773901.000.6250.034

Top1:

0.7479(FLOAT)/0.7453(INT8)

ImageNet
EfficientNet_Lite1

1x240x240x3

1.203175.900.6840.034

Top1:

0.7652(FLOAT)/0.7609(INT8)

ImageNet
EfficientNet_Lite2

1x260x260x3

1.722483.400.7740.034

Top1:

0.7734(FLOAT)/0.7697(INT8)

ImageNet
EfficientNet_Lite3

1x280x280x3

2.771874.500.9040.034

Top1:

0.7917(FLOAT)/0.7895(INT8)

ImageNet
EfficientNet_Lite4

1x300x300x3

5.111289.701.1480.034

Top1:

0.8063(FLOAT)/0.8046(INT8)

ImageNet
Vargconvnet

1x3x224x224

9.061465.101.0260.033

Top1:

0.7793(FLOAT)/0.7770(INT8)

ImageNet
Efficientnasnet_m

1x3x300x300

4.531478.801.0220.033

Top1:

0.7935(FLOAT)/0.7923(INT8)

ImageNet
Efficientnasnet_s

1x3x280x280

1.443336.500.6420.033

Top1:

0.7441(FLOAT)/0.7524(INT8)

ImageNet
ResNet18

1x3x224x224

3.632555.500.7290.034

Top1:

0.7169(FLOAT)/0.7162(INT8)

ImageNet
YOLOv2_Darknet19

1x3x608x608

62.94227.714.7770.311

[IoU=0.50:0.95]=

0.2760(FLOAT)/0.2700(INT8)

COCO
YOLOv3_Darknet53

1x3x416x416

65.86210.495.1871.773

[IoU=0.50:0.95]=

0.3370(FLOAT)/0.3360(INT8)

COCO
YOLOv5x_v2.0

1x3x672x672

243.8562.3916.5795.904

[IoU=0.50:0.95]=

0.4810(FLOAT)/0.4670(INT8)

COCO
SSD_MobileNetv1

1x3x300x300

2.303188.000.7250.198

mAP:

0.7345(FLOAT)/0.7269(INT8)

VOC
Centernet_resnet101

1x3x512x512

90.53186.435.7910.993

[IoU=0.50:0.95]=

0.3420(FLOAT)/0.3270(INT8)

COCO
YOLOv3_VargDarknet

1x3x416x416

42.82306.473.7041.662

[IoU=0.50:0.95]=

0.3280(FLOAT)/0.3270(INT8)

COCO
Deeplabv3plus_efficientnetb0

1x3x1024x2048

30.77152.017.0100.311

mIoU:

0.7630(FLOAT)/0.7571(INT8)

Cityscapes
Fastscnn_efficientnetb0

1x3x1024x2048

12.48249.274.4330.311

mIoU:

0.6997(FLOAT)/0.6914(INT8)

Cityscapes
Deeplabv3plus_efficientnetm1

1x3x1024x2048

77.0492.2811.2640.314

mIoU:

0.7794(FLOAT)/0.7754(INT8)

Cityscapes
Deeplabv3plus_efficientnetm2

1x3x1024x2048

124.1564.8215.8660.312

mIoU:

0.7882(FLOAT)/0.7854(INT8)

Cityscapes
Bev_gkt_mixvargenet_multitask

image:

6x3x512x960

points(0-8):

6x64x64x2

207.1668.3815.8934.207

NDS:

0.2810(FLOAT)/0.2786(INT8)

MeanIOU:

0.4852(FLOAT)/0.4836(INT8)

mAP:

0.1990(FLOAT)/0.2004(INT8)

Nuscenes
Bev_ipm_4d_efficientnetb0_multitask

image:

6x3x512x960

points:

6x128x128x2

prev_feat:

1x164x28x128

prev_point:

1x128x128x2

53.58112.2710.4884.276

NDS:

0.3721(FLOAT)/0.3728(INT8)

MeanIOU:

0.5287(FLOAT)/0.5388(INT8)

mAP:

0.2200(FLOAT)/0.2216(INT8)

Nuscenes
Bev_ipm_efficientnetb0_multitask

image:

6x3x512x960

points:

6x128x128x2

52.97115.249.8224.256

NDS:

0.3056(FLOAT)/0.3041(INT8)

MeanIOU:

0.5145(FLOAT)/0.5104(INT8)

mAP:

0.2170(FLOAT)/0.2163(INT8)

Nuscenes
Bev_lss_efficientnetb0_multitask

image:

6x3x256x704

points(0&1):

10x128x128x2

24.06187.016.5014.213

NDS:

0.3006(FLOAT)/0.3005(INT8)

MeanIOU:

0.5180(FLOAT)/0.5147(INT8)

mAP:

0.2061(FLOAT)/0.2043(INT8)

Nuscenes
Detr3d_efficientnetb3

coords(0-3):

6x4x256x2

image:

6x3x512x1408

masks:

1x4x256x24

227.7132.1031.8411.104

NDS:

0.3304(FLOAT)/0.3280(INT8)

mAP:

0.2752(FLOAT)/0.2706(INT8)

Nuscenes
Petr_efficientnetb3

image:

6x3x512x1408

pos_embed:

1x96x44x256

219.1719.2852.6631.122

NDS:

0.3765(FLOAT)/0.3734(INT8)

mAP:

0.3038(FLOAT)/0.2930(INT8)

Nuscenes
Bevformer_tiny_resnet50_detection

img:

6x3x480x800

prev_bev:

1x2500x256

prev_bev_ref:

1x50x50x2

queries_rebatch_grid:

6x20x32x2

restore_bev_grid:

1x100x50x2

reference_points_rebatch:

6x640x4x2

bev_pillar_counts:

1x2500x1

387.2931.1842.0611.410

NDS:

0.3713(FLOAT)/0.3679(INT8)

mAP:

0.2673(FLOAT)/0.2614(INT8)

Nuscenes
Flashocc_henet_lss_occ3d_nuscenes

img:

6x3x512x960

points:

10x128x128x2

points_depth:

10x128x128x2

126.7596.4211.47640.473

mIoU:

0.3674(FLOAT)/0.3639(INT8)

Nuscenes
Horizon_swin_transformer

1x3x224x224

8.98310.553.5890.035

Top1:

0.8024(FLOAT)/0.7958(INT8)

ImageNet
Mixvargenet

1x3x224x224

2.074466.900.5300.034

Top1:

0.7075(FLOAT)/0.7049(INT8)

ImageNet
Vargnetv2

1x3x224x224

0.724127.500.5770.034

Top1:

0.7342(FLOAT)/0.7326(INT8)

ImageNet
Vit_small

1x3x224x224

9.20545.782.1900.034

Top1:

0.7950(FLOAT)/0.7933(INT8)

ImageNet
Centerpoint_pointpillar

points:

300000x5

voxel_feature:

1x5x20x40000

coors:

40000x4

127.73124.7516.65613.024

NDS:

0.5832(FLOAT)/0.5816(INT8)

mAP:

0.4804(FLOAT)/0.4784(INT8)

Nuscenes
Detr_efficientnetb3

1x3x800x1333

67.3952.7419.3790.340

[IoU=0.50:0.95]=

0.3721(FLOAT)/0.3595(INT8)

MS COCO
Detr_resnet50

1x3x800x1333

203.0740.4625.3040.353

[IoU=0.50:0.95]=

0.3569(FLOAT)/0.3161(INT8)

MS COCO
FCOS3D_efficientnetb0

1x3x512x896

19.94447.923.3462.732

NDS:

0.3062(FLOAT)/0.3030(INT8)

mAP:

0.2133(FLOAT)/0.2069(INT8)

nuscenes
Fcos_efficientnetb0

1x3x512x512

5.021080.301.6150.137

[IoU=0.50:0.95]=

0.3626(FLOAT)/0.3553(INT8)

MS COCO
Ganet_mixvargenet

1x3x320x800

10.741573.201.0180.213

F1Score:

0.7949(FLOAT)/0.7882(INT8)

CuLane
Keypoint_efficientnetb0

1x3x128x128

0.454317.900.5430.073

PCK(alpha=0.1):

0.9433(FLOAT)/0.9432(INT8)

Carfusion
Pointpillars_kitti_car

150000x4

66.82150.4532.9230.539

APDet=

0.7732(FLOAT)/0.7678(INT8)

Kitti3d
Deformable_detr_resnet50

1x3x800x1333

408.945.27190.37015.590

[IoU=0.50:0.95]=

0.4414(FLOAT)/0.4197(INT8)

MS COCO
Stereonetplus_mixvargenet

2x3x544x960

48.57229.344.8681.973

EPE:

1.1270(FLOAT)/1.1341(INT8)

SceneFlow
Centerpoint_mixvargnet_multitask

points:

300000x5

voxel_feature:

1x5x20x40000

coors:

40000x4

51.45186.6114.07411.740

NDS:

0.5809(FLOAT)/0.5753(INT8)

MeanIOU:

0.9128(FLOAT)/0.9121(INT8)

mAP:

0.4726(FLOAT)/0.4626(INT8)

Nuscenes
Unet_mobilenetv1

1x3x1024x2048

7.36810.011.7390.149

mIoU:

0.6802(FLOAT)/0.6758(INT8)

Cityscapes
Motr_efficientnetb3

image:

1x800x1422x3

track_query:

1x2x128x156

ref_points:

1x2x128x4

mask_query:

1x1x256x1

64.4374.6413.6005.098

MOTA:

0.5805(FLOAT)/0.5749(INT8)

Mot17
Densetnt_vectornet

goals_2d:

30x1x2048x2

goals_2d_mask:

30x1x2048x1

instance_mask:

30x1x96x1

lane_feat:

30x9x64x11

traj_feat:

30x19x32x9

12.50104.5310.3942.315

minFDA:

1.2975(FLOAT)/1.3054(INT8)

Argoverse 1
Maptroe_henet_tinym_bevformer

img:

6x3x480x800

osm_mask:

1x1x50x100

queries_rebatch_grid:

6x20x100x2

restore_bev_grid:

1x100x100x2

reference_points_rebatch:

6x2000x4x2

bev_pillar_counts:

1x5000x1

134.5775.3513.9610.260

mAP:

0.6633(FLOAT)/0.6572(INT8)

Nuscenes
Qcnet_oe

valid_mask:

1x30x10

valid_mask_a2a:

1x10x30x30

agent_type:

1x30x1

x_a_cur:

1x1x30x1,1x1x30x1,1x1x30x1,1x1x30x1

r_pl2a_cur:

1x1x30x80,1x1x30x80,1x1x30x80

r_t_cur:

1x1x30x6,1x1x30x6,1x1x30x6,1x1x30x6

r_a2a_cur:

1x1x30x30,1x1x30x30,1x1x30x30

x_a_mid_emb:

1x30x2x128

x_a:

1x30x6x128

pl_type,is_intersection:

1x80

r_pl2pl:

1x1x80x80,1x1x80x80,1x1x80x80

r_pt2pl:

1x1x80x50,1x1x80x50,1x1x80x50

mask_pl2pl:

1x80x80

magnitude,pt_type,side,mask:

1x80x50

mask_a2m:

1x30x30

mask_dst:

1x30x1

type_pl2pl:

1x80x80

7.85236.246.3090.867

hitrate:

0.8025(FLOAT)/0.7953(INT8)

Argoverse 2

Model Full Performance Data

MobileNetv1

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 1.14
  • FPS: 4249.80
  • ITC(ms): 0.527
  • TCPP(ms): 0.034
  • RV(mb): 4.56
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7373(FLOAT)/0.7295(INT8)

MobileNetv2

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 0.63
  • FPS: 4272.40
  • ITC(ms): 0.544
  • TCPP(ms): 0.034
  • RV(mb): 3.95
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7217(FLOAT)/0.7146(INT8)

ResNet50

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 7.72
  • FPS: 1155.20
  • ITC(ms): 1.217
  • TCPP(ms): 0.034
  • RV(mb): 26.08
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7703(FLOAT)/0.7673(INT8)

GoogleNet

EfficientNet_Lite0

EfficientNet_Lite1

EfficientNet_Lite2

EfficientNet_Lite3

EfficientNet_Lite4

Vargconvnet

Efficientnasnet_m

Efficientnasnet_s

ResNet18

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 3.63
  • FPS: 2555.50
  • ITC(ms): 0.729
  • TCPP(ms): 0.034
  • RV(mb): 11.87
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7169(FLOAT)/0.7162(INT8)

YOLOv2_Darknet19

  • INPUT SIZE: 1x3x608x608
  • C(GOPs): 62.94
  • FPS: 227.71
  • ITC(ms): 4.777
  • TCPP(ms): 0.311
  • RV(mb): 51.86
  • WV(mb): 0.77
  • Dataset: COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.2760(FLOAT)/0.2700(INT8)
  • LINKS: https://pjreddie.com/darknet/yolo

YOLOv3_Darknet53

  • INPUT SIZE: 1x3x416x416
  • C(GOPs): 65.86
  • FPS: 210.49
  • ITC(ms): 5.187
  • TCPP(ms): 1.773
  • RV(mb): 68.45
  • WV(mb): 9.38
  • Dataset: COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3370(FLOAT)/0.3360(INT8)
  • LINKS: https://github.com/ChenYingpeng/caffe-yolov3/

YOLOv5x_v2.0

SSD_MobileNetv1

  • INPUT SIZE: 1x3x300x300
  • C(GOPs): 2.30
  • FPS: 3188.00
  • ITC(ms): 0.725
  • TCPP(ms): 0.198
  • RV(mb): 6.24
  • WV(mb): 0.21
  • Dataset: VOC
  • ACCURACY: mAP: 0.7345(FLOAT)/0.7269(INT8)
  • LINKS: https://github.com/chuanqi305/MobileNet-SSD

Centernet_resnet101

YOLOv3_VargDarknet

Deeplabv3plus_efficientnetb0

Fastscnn_efficientnetb0

Deeplabv3plus_efficientnetm1

Deeplabv3plus_efficientnetm2

Bev_gkt_mixvargenet_multitask

  • INPUT SIZE: image: 6x3x512x960 points(0-8): 6x64x64x2
  • C(GOPs): 207.16
  • FPS: 68.38
  • ITC(ms): 15.893
  • TCPP(ms): 4.207
  • RV(mb): 120.20
  • WV(mb): 96.40
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.2810(FLOAT)/0.2786(INT8) MeanIOU: 0.4852(FLOAT)/0.4836(INT8) mAP: 0.1990(FLOAT)/0.2004(INT8)

Bev_ipm_4d_efficientnetb0_multitask

  • INPUT SIZE: image: 6x3x512x960 points: 6x128x128x2 prev_feat: 1x164x28x128 prev_point: 1x128x128x2
  • C(GOPs): 53.58
  • FPS: 112.27
  • ITC(ms): 10.488
  • TCPP(ms): 4.276
  • RV(mb): 63.66
  • WV(mb): 49.97
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3721(FLOAT)/0.3728(INT8) MeanIOU: 0.5287(FLOAT)/0.5388(INT8) mAP: 0.2200(FLOAT)/0.2216(INT8)

Bev_ipm_efficientnetb0_multitask

  • INPUT SIZE: image: 6x3x512x960 points: 6x128x128x2
  • C(GOPs): 52.97
  • FPS: 115.24
  • ITC(ms): 9.822
  • TCPP(ms): 4.256
  • RV(mb): 60.37
  • WV(mb): 47.87
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3056(FLOAT)/0.3041(INT8) MeanIOU: 0.5145(FLOAT)/0.5104(INT8) mAP: 0.2170(FLOAT)/0.2163(INT8)

Bev_lss_efficientnetb0_multitask

  • INPUT SIZE: image: 6x3x256x704 points(0&1): 10x128x128x2
  • C(GOPs): 24.06
  • FPS: 187.01
  • ITC(ms): 6.501
  • TCPP(ms): 4.213
  • RV(mb): 25.43
  • WV(mb): 19.02
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3006(FLOAT)/0.3005(INT8) MeanIOU: 0.5180(FLOAT)/0.5147(INT8) mAP: 0.2061(FLOAT)/0.2043(INT8)

Detr3d_efficientnetb3

  • INPUT SIZE: coords(0-3): 6x4x256x2 image: 6x3x512x1408 masks: 1x4x256x24
  • C(GOPs): 227.71
  • FPS: 32.10
  • ITC(ms): 31.841
  • TCPP(ms): 1.104
  • RV(mb): 333.48
  • WV(mb): 175.59
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3304(FLOAT)/0.3280(INT8) mAP: 0.2752(FLOAT)/0.2706(INT8)

Petr_efficientnetb3

  • INPUT SIZE: image: 6x3x512x1408 pos_embed: 1x96x44x256
  • C(GOPs): 219.17
  • FPS: 19.28
  • ITC(ms): 52.663
  • TCPP(ms): 1.122
  • RV(mb): 261.01
  • WV(mb): 144.25
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3765(FLOAT)/0.3734(INT8) mAP: 0.3038(FLOAT)/0.2930(INT8)

Bevformer_tiny_resnet50_detection

  • INPUT SIZE: img: 6x3x480x800 prev_bev: 1x2500x256 prev_bev_ref: 1x50x50x2 queries_rebatch_grid: 6x20x32x2 restore_bev_grid: 1x100x50x2 reference_points_rebatch: 6x640x4x2 bev_pillar_counts: 1x2500x1
  • C(GOPs): 387.29
  • FPS: 31.18
  • ITC(ms): 42.061
  • TCPP(ms): 1.410
  • RV(mb): 265.59
  • WV(mb): 175.42
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3713(FLOAT)/0.3679(INT8) mAP: 0.2673(FLOAT)/0.2614(INT8)

Flashocc_henet_lss_occ3d_nuscenes

  • INPUT SIZE: img: 6x3x512x960 points: 10x128x128x2 points_depth: 10x128x128x2
  • C(GOPs): 126.75
  • FPS: 96.42
  • ITC(ms): 11.476
  • TCPP(ms): 40.473
  • RV(mb): 87.47
  • WV(mb): 55.84
  • Dataset: Nuscenes
  • ACCURACY: mIoU: 0.3674(FLOAT)/0.3639(INT8)

Horizon_swin_transformer

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 8.98
  • FPS: 310.55
  • ITC(ms): 3.589
  • TCPP(ms): 0.035
  • RV(mb): 45.99
  • WV(mb): 6.52
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.8024(FLOAT)/0.7958(INT8)

Mixvargenet

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 2.07
  • FPS: 4466.90
  • ITC(ms): 0.530
  • TCPP(ms): 0.034
  • RV(mb): 2.51
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7075(FLOAT)/0.7049(INT8)

Vargnetv2

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 0.72
  • FPS: 4127.50
  • ITC(ms): 0.577
  • TCPP(ms): 0.034
  • RV(mb): 4.68
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7342(FLOAT)/0.7326(INT8)

Vit_small

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 9.20
  • FPS: 545.78
  • ITC(ms): 2.190
  • TCPP(ms): 0.034
  • RV(mb): 26.29
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7950(FLOAT)/0.7933(INT8)

Centerpoint_pointpillar

  • INPUT SIZE: points: 300000x5 voxel_feature: 1x5x20x40000 coors: 40000x4
  • C(GOPs): 127.73
  • FPS: 124.75
  • ITC(ms): 16.656
  • TCPP(ms): 13.024
  • RV(mb): 51.37
  • WV(mb): 25.83
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.5832(FLOAT)/0.5816(INT8) mAP: 0.4804(FLOAT)/0.4784(INT8)

Detr_efficientnetb3

  • INPUT SIZE: 1x3x800x1333
  • C(GOPs): 67.39
  • FPS: 52.74
  • ITC(ms): 19.379
  • TCPP(ms): 0.340
  • RV(mb): 261.92
  • WV(mb): 134.89
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3721(FLOAT)/0.3595(INT8)

Detr_resnet50

  • INPUT SIZE: 1x3x800x1333
  • C(GOPs): 203.07
  • FPS: 40.46
  • ITC(ms): 25.304
  • TCPP(ms): 0.353
  • RV(mb): 357.82
  • WV(mb): 222.85
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3569(FLOAT)/0.3161(INT8)

FCOS3D_efficientnetb0

  • INPUT SIZE: 1x3x512x896
  • C(GOPs): 19.94
  • FPS: 447.92
  • ITC(ms): 3.346
  • TCPP(ms): 2.732
  • RV(mb): 11.23
  • WV(mb): 4.17
  • Dataset: nuscenes
  • ACCURACY: NDS: 0.3062(FLOAT)/0.3030(INT8) mAP: 0.2133(FLOAT)/0.2069(INT8)

Fcos_efficientnetb0

  • INPUT SIZE: 1x3x512x512
  • C(GOPs): 5.02
  • FPS: 1080.30
  • ITC(ms): 1.615
  • TCPP(ms): 0.137
  • RV(mb): 6.09
  • WV(mb): 2.68
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3626(FLOAT)/0.3553(INT8)

Ganet_mixvargenet

  • INPUT SIZE: 1x3x320x800
  • C(GOPs): 10.74
  • FPS: 1573.20
  • ITC(ms): 1.018
  • TCPP(ms): 0.213
  • RV(mb): 2.16
  • WV(mb): 0.52
  • Dataset: CuLane
  • ACCURACY: F1Score: 0.7949(FLOAT)/0.7882(INT8)

Keypoint_efficientnetb0

  • INPUT SIZE: 1x3x128x128
  • C(GOPs): 0.45
  • FPS: 4317.90
  • ITC(ms): 0.543
  • TCPP(ms): 0.073
  • RV(mb): 4.62
  • WV(mb): 0.01
  • Dataset: Carfusion
  • ACCURACY: PCK(alpha=0.1): 0.9433(FLOAT)/0.9432(INT8)

Pointpillars_kitti_car

  • INPUT SIZE: 150000x4
  • C(GOPs): 66.82
  • FPS: 150.45
  • ITC(ms): 32.923
  • TCPP(ms): 0.539
  • RV(mb): 69.93
  • WV(mb): 30.00
  • Dataset: Kitti3d
  • ACCURACY: APDet= 0.7732(FLOAT)/0.7678(INT8)

Deformable_detr_resnet50

  • INPUT SIZE: 1x3x800x1333
  • C(GOPs): 408.94
  • FPS: 5.27
  • ITC(ms): 190.370
  • TCPP(ms): 15.590
  • RV(mb): 3495.68
  • WV(mb): 2486.20
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.4414(FLOAT)/0.4197(INT8)

Stereonetplus_mixvargenet

  • INPUT SIZE: 2x3x544x960
  • C(GOPs): 48.57
  • FPS: 229.34
  • ITC(ms): 4.868
  • TCPP(ms): 1.973
  • RV(mb): 27.85
  • WV(mb): 25.98
  • Dataset: SceneFlow
  • ACCURACY: EPE: 1.1270(FLOAT)/1.1341(INT8)

Centerpoint_mixvargnet_multitask

  • INPUT SIZE: points: 300000x5 voxel_feature: 1x5x20x40000 coors: 40000x4
  • C(GOPs): 51.45
  • FPS: 186.61
  • ITC(ms): 14.074
  • TCPP(ms): 11.740
  • RV(mb): 32.08
  • WV(mb): 16.79
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.5809(FLOAT)/0.5753(INT8) MeanIOU: 0.9128(FLOAT)/0.9121(INT8) mAP: 0.4726(FLOAT)/0.4626(INT8)

Unet_mobilenetv1

  • INPUT SIZE: 1x3x1024x2048
  • C(GOPs): 7.36
  • FPS: 810.01
  • ITC(ms): 1.739
  • TCPP(ms): 0.149
  • RV(mb): 13.27
  • WV(mb): 7.60
  • Dataset: Cityscapes
  • ACCURACY: mIoU: 0.6802(FLOAT)/0.6758(INT8)

Motr_efficientnetb3

  • INPUT SIZE: image: 1x800x1422x3 track_query: 1x2x128x156 ref_points: 1x2x128x4 mask_query: 1x1x256x1
  • C(GOPs): 64.43
  • FPS: 74.64
  • ITC(ms): 13.600
  • TCPP(ms): 5.098
  • RV(mb): 114.93
  • WV(mb): 47.16
  • Dataset: Mot17
  • ACCURACY: MOTA: 0.5805(FLOAT)/0.5749(INT8)

Densetnt_vectornet

  • INPUT SIZE: goals_2d: 30x1x2048x2 goals_2d_mask: 30x1x2048x1 instance_mask: 30x1x96x1 lane_feat: 30x9x64x11 traj_feat: 30x19x32x9
  • C(GOPs): 12.50
  • FPS: 104.53
  • ITC(ms): 10.394
  • TCPP(ms): 2.315
  • RV(mb): 53.07
  • WV(mb): 33.59
  • Dataset: Argoverse 1
  • ACCURACY: minFDA: 1.2975(FLOAT)/1.3054(INT8)

Maptroe_henet_tinym_bevformer

  • INPUT SIZE: img: 6x3x480x800 osm_mask: 1x1x50x100 queries_rebatch_grid: 6x20x100x2 restore_bev_grid: 1x100x100x2 reference_points_rebatch: 6x2000x4x2 bev_pillar_counts: 1x5000x1
  • C(GOPs): 134.57
  • FPS: 75.35
  • ITC(ms): 13.961
  • TCPP(ms): 0.260
  • RV(mb): 121.59
  • WV(mb): 36.83
  • Dataset: Nuscenes
  • ACCURACY: mAP: 0.6633(FLOAT)/0.6572(INT8)

Qcnet_oe

  • INPUT SIZE: valid_mask: 1x30x10 valid_mask_a2a: 1x10x30x30 agent_type: 1x30x1 x_a_cur: 1x1x30x1,1x1x30x1,1x1x30x1,1x1x30x1 r_pl2a_cur: 1x1x30x80,1x1x30x80,1x1x30x80 r_t_cur: 1x1x30x6,1x1x30x6,1x1x30x6,1x1x30x6 r_a2a_cur: 1x1x30x30,1x1x30x30,1x1x30x30 x_a_mid_emb: 1x30x2x128 x_a: 1x30x6x128 pl_type,is_intersection: 1x80 r_pl2pl: 1x1x80x80,1x1x80x80,1x1x80x80 r_pt2pl: 1x1x80x50,1x1x80x50,1x1x80x50 mask_pl2pl: 1x80x80 magnitude,pt_type,side,mask: 1x80x50 mask_a2m: 1x30x30 mask_dst: 1x30x1 type_pl2pl: 1x80x80
  • C(GOPs): 7.85
  • FPS: 236.24
  • ITC(ms): 6.309
  • TCPP(ms): 0.867
  • RV(mb): 37.89
  • WV(mb): 18.04
  • Dataset: Argoverse 2
  • ACCURACY: hitrate: 0.8025(FLOAT)/0.7953(INT8)