模型性能Benchmark

说明

  • 测试条件:

    • 测试开发板:J6E。

    • 测试核心数:单核。

    • 性能数据获取频率设置为:5分钟时间内性能参数的平均值。

    • Python版本:Python3.10。

    • 模型来源:OE包内 samples/ucp_tutorial/dnn/ai_benchmark/j6 路径下的模型。

  • 缩写说明:

    • C = 计算量,单位为GOPs(十亿次运算/秒)。此数据通过调用 hbm_perf 接口获得。

    • FPS = 每秒帧率。此数据在开发板多线程运行ai_benchmark示例包/script路径下各模型子文件夹的 fps.sh 脚本获取,包含后处理。

    • ITC = 推理耗时,单位为ms(毫秒)。此数据在开发板单线程运行ai_benchmark示例包/script路径下各模型子文件夹的 latency.sh 脚本获取,不含后处理。

    • TCPP = 后处理耗时,单位为ms(毫秒)。此数据在开发板单线程运行ai_benchmark示例包/script路径下各模型子文件夹的 latency.sh 脚本获取。

    • RV = 单次推理读取数据量,单位为mb(兆比特)。此数据通过调用 hbm_perf 接口获得。

    • WV = 单次推理写入数据量,单位为mb(兆比特)。此数据通过调用 hbm_perf 接口获得。

模型主要性能数据

MODEL NAMEINPUT SIZEC(GOPs)FPSITC(ms)TCPP(ms)ACCURACYDataset
MobileNetv1

1x3x224x224

1.144753.300.4800.034

Top1:

0.7374(FLOAT)/0.7298(INT8)

ImageNet
MobileNetv2

1x3x224x224

0.634706.600.5050.035

Top1:

0.7217(FLOAT)/0.7147(INT8)

ImageNet
ResNet50

1x3x224x224

7.721131.001.1820.035

Top1:

0.7703(FLOAT)/0.7678(INT8)

ImageNet
GoogleNet

1x3x224x224

3.002799.500.6890.034

Top1:

0.7018(FLOAT)/0.6993(INT8)

ImageNet
EfficientNet_Lite0

1x224x224x3

0.774171.000.5820.034

Top1:

0.7479(FLOAT)/0.7453(INT8)

ImageNet
EfficientNet_Lite1

1x240x240x3

1.203215.300.6550.034

Top1:

0.7652(FLOAT)/0.7609(INT8)

ImageNet
EfficientNet_Lite2

1x260x260x3

1.722405.100.7600.034

Top1:

0.7734(FLOAT)/0.7697(INT8)

ImageNet
EfficientNet_Lite3

1x280x280x3

2.771849.300.8930.034

Top1:

0.7917(FLOAT)/0.7887(INT8)

ImageNet
EfficientNet_Lite4

1x300x300x3

5.111272.601.1270.034

Top1:

0.8063(FLOAT)/0.8043(INT8)

ImageNet
Vargconvnet

1x3x224x224

9.061497.001.0050.033

Top1:

0.7793(FLOAT)/0.7762(INT8)

ImageNet
Efficientnasnet_m

1x3x300x300

4.531429.001.0300.034

Top1:

0.7935(FLOAT)/0.7924(INT8)

ImageNet
Efficientnasnet_s

1x3x280x280

1.443335.500.6290.034

Top1:

0.7441(FLOAT)/0.7522(INT8)

ImageNet
ResNet18

1x3x224x224

3.632542.600.6830.034

Top1:

0.7169(FLOAT)/0.7164(INT8)

ImageNet
YOLOv2_Darknet19

1x3x608x608

62.94225.314.7530.304

[IoU=0.50:0.95]=

0.2760(FLOAT)/0.2700(INT8)

COCO
YOLOv3_Darknet53

1x3x416x416

65.86209.305.1611.714

[IoU=0.50:0.95]=

0.3370(FLOAT)/0.3360(INT8)

COCO
YOLOv5x_v2.0

1x3x672x672

243.8561.1116.8235.916

[IoU=0.50:0.95]=

0.4810(FLOAT)/0.4670(INT8)

COCO
SSD_MobileNetv1

1x3x300x300

2.302975.600.7090.197

mAP:

0.7345(FLOAT)/0.7269(INT8)

VOC
Centernet_resnet101

1x3x512x512

90.53120.528.6630.993

[IoU=0.50:0.95]=

0.3420(FLOAT)/0.3240(INT8)

COCO
YOLOv3_VargDarknet

1x3x416x416

42.82307.323.6461.647

[IoU=0.50:0.95]=

0.3280(FLOAT)/0.3270(INT8)

COCO
Deeplabv3plus_efficientnetb0

1x3x1024x2048

30.77148.777.0900.317

mIoU:

0.7630(FLOAT)/0.7570(INT8)

Cityscapes
Fastscnn_efficientnetb0

1x3x1024x2048

12.48255.004.2820.317

mIoU:

0.6997(FLOAT)/0.6910(INT8)

Cityscapes
Deeplabv3plus_efficientnetm1

1x3x1024x2048

77.0490.3311.4640.310

mIoU:

0.7794(FLOAT)/0.7754(INT8)

Cityscapes
Deeplabv3plus_efficientnetm2

1x3x1024x2048

124.1564.3315.9130.316

mIoU:

0.7882(FLOAT)/0.7853(INT8)

Cityscapes
Bev_gkt_mixvargenet_multitask

image:

6x3x512x960

points(0-8):

6x64x64x2

207.1663.3316.9895.490

NDS:

0.2810(FLOAT)/0.2787(INT8)

MeanIOU:

0.4852(FLOAT)/0.4835(INT8)

mAP:

0.1991(FLOAT)/0.1992(INT8)

Nuscenes
Bev_ipm_4d_efficientnetb0_multitask

image:

6x3x512x960

points:

6x128x128x2

prev_feat:

1x164x28x128

prev_point:

1x128x128x2

53.58108.4910.6995.494

NDS:

0.3721(FLOAT)/0.3735(INT8)

MeanIOU:

0.5287(FLOAT)/0.5387(INT8)

mAP:

0.2200(FLOAT)/0.2217(INT8)

Nuscenes
Bev_ipm_efficientnetb0_multitask

image:

6x3x512x960

points:

6x128x128x2

52.97112.139.9965.468

NDS:

0.3056(FLOAT)/0.3029(INT8)

MeanIOU:

0.5145(FLOAT)/0.5098(INT8)

mAP:

0.2170(FLOAT)/0.2163(INT8)

Nuscenes
Bev_lss_efficientnetb0_multitask

image:

6x3x256x704

points(0&1):

10x128x128x2

24.06178.756.6705.438

NDS:

0.3007(FLOAT)/0.3017(INT8)

MeanIOU:

0.5180(FLOAT)/0.5147(INT8)

mAP:

0.2062(FLOAT)/0.2050(INT8)

Nuscenes
Detr3d_efficientnetb3

coords(0-3):

6x4x256x2

image:

6x3x512x1408

masks:

1x4x256x24

227.7129.4534.6241.117

NDS:

0.3304(FLOAT)/0.3279(INT8)

mAP:

0.2752(FLOAT)/0.2703(INT8)

Nuscenes
Petr_efficientnetb3

image:

6x3x512x1408

pos_embed:

1x96x44x256

219.1719.0253.1871.130

NDS:

0.3765(FLOAT)/0.3741(INT8)

mAP:

0.3038(FLOAT)/0.2934(INT8)

Nuscenes
Bevformer_tiny_resnet50_detection

img:

6x3x480x800

prev_bev:

1x2500x256

prev_bev_ref:

1x50x50x2

queries_rebatch_grid:

6x20x32x2

restore_bev_grid:

1x100x50x2

reference_points_rebatch:

6x640x4x2

bev_pillar_counts:

1x2500x1

387.2928.8444.5731.405

NDS:

0.3713(FLOAT)/0.3679(INT8)

mAP:

0.2673(FLOAT)/0.2614(INT8)

Nuscenes
Flashocc_henet_lss_occ3d_nuscenes

img:

6x3x512x960

points:

10x128x128x2

points_depth:

10x128x128x2

126.7589.1012.29940.297

mIoU:

0.3674(FLOAT)/0.3642(INT8)

Nuscenes
Horizon_swin_transformer

1x3x224x224

8.98291.913.7300.034

Top1:

0.8024(FLOAT)/0.7947(INT8)

ImageNet
Mixvargenet

1x3x224x224

2.074935.200.4880.034

Top1:

0.7075(FLOAT)/0.7063(INT8)

ImageNet
Vargnetv2

1x3x224x224

0.724254.400.5350.035

Top1:

0.7342(FLOAT)/0.7317(INT8)

ImageNet
Vit_small

1x3x224x224

9.20533.302.1740.034

Top1:

0.7950(FLOAT)/0.7927(INT8)

ImageNet
Centerpoint_pointpillar

points:

300000x5

voxel_feature:

1x5x20x40000

coors:

40000x4

127.7389.9760.18313.971

NDS:

0.5832(FLOAT)/0.5819(INT8)

mAP:

0.4804(FLOAT)/0.4780(INT8)

Nuscenes
Detr_efficientnetb3

1x3x800x1333

67.3953.5919.0330.345

[IoU=0.50:0.95]=

0.3721(FLOAT)/0.3605(INT8)

MS COCO
Detr_resnet50

1x3x800x1333

203.0739.7525.5490.345

[IoU=0.50:0.95]=

0.3569(FLOAT)/0.3142(INT8)

MS COCO
FCOS3D_efficientnetb0

1x3x512x896

19.94426.753.4052.740

NDS:

0.3061(FLOAT)/0.3029(INT8)

mAP:

0.2133(FLOAT)/0.2079(INT8)

nuscenes
Fcos_efficientnetb0

1x3x512x512

5.021043.501.9310.136

[IoU=0.50:0.95]=

0.3626(FLOAT)/0.3565(INT8)

MS COCO
Ganet_mixvargenet

1x3x320x800

10.741478.001.0130.211

F1Score:

0.7949(FLOAT)/0.7881(INT8)

CuLane
Keypoint_efficientnetb0

1x3x128x128

0.454697.000.4910.071

PCK(alpha=0.1):

0.9433(FLOAT)/0.9432(INT8)

Carfusion
Pointpillars_kitti_car

150000x4

66.8223.73229.5100.537

APDet=

0.7733(FLOAT)/0.7676(INT8)

Kitti3d
Deformable_detr_resnet50

1x3x800x1333

408.944.76210.47015.570

[IoU=0.50:0.95]=

0.4414(FLOAT)/0.4204(INT8)

MS COCO
Stereonetplus_mixvargenet

2x3x544x960

48.57208.935.2191.960

EPE:

1.1270(FLOAT)/1.1342(INT8)

SceneFlow
Centerpoint_mixvargnet_multitask

points:

300000x5

voxel_feature:

1x5x20x40000

coors:

40000x4

51.4590.5957.67812.097

NDS:

0.5809(FLOAT)/0.5754(INT8)

MeanIOU:

0.9128(FLOAT)/0.9121(INT8)

mAP:

0.4726(FLOAT)/0.4629(INT8)

Nuscenes
Unet_mobilenetv1

1x3x1024x2048

7.36780.851.7280.148

mIoU:

0.6802(FLOAT)/0.6757(INT8)

Cityscapes
Motr_efficientnetb3

image:

1x800x1422x3

track_query:

1x2x128x156

ref_points:

1x2x128x4

mask_query:

1x1x256x1

64.4371.2714.1115.135

MOTA:

0.5805(FLOAT)/0.5728(INT8)

Mot17
Densetnt_vectornet

goals_2d:

30x1x2048x2

goals_2d_mask:

30x1x2048x1

instance_mask:

30x1x96x1

lane_feat:

30x9x64x11

traj_feat:

30x19x32x9

12.50155.0611.6072.302

minFDA:

1.2975(FLOAT)/1.3058(INT8)

Argoverse 1
Maptroe_henet_tinym_bevformer

img:

6x3x480x800

osm_mask:

1x1x50x100

queries_rebatch_grid:

6x20x100x2

restore_bev_grid:

1x100x100x2

reference_points_rebatch:

6x2000x4x2

bev_pillar_counts:

1x5000x1

134.5767.7815.3500.254

mAP:

0.6633(FLOAT)/0.6509(INT8)

Nuscenes
Qcnet_oe

valid_mask:

1x30x10

valid_mask_a2a:

1x10x30x30

agent_type:

1x30x1

x_a_cur:

1x1x30x1,1x1x30x1,1x1x30x1,1x1x30x1

r_pl2a_cur:

1x1x30x80,1x1x30x80,1x1x30x80

r_t_cur:

1x1x30x6,1x1x30x6,1x1x30x6,1x1x30x6

r_a2a_cur:

1x1x30x30,1x1x30x30,1x1x30x30

x_a_mid_emb:

1x30x2x128

x_a:

1x30x6x128

pl_type,is_intersection:

1x80

r_pl2pl:

1x1x80x80,1x1x80x80,1x1x80x80

r_pt2pl:

1x1x80x50,1x1x80x50,1x1x80x50

mask_pl2pl:

1x80x80

magnitude,pt_type,side,mask:

1x80x50

mask_a2m:

1x30x30

mask_dst:

1x30x1

type_pl2pl:

1x80x80

7.85201.8512.9350.822

hitrate:

0.8026(FLOAT)/0.7906(INT8)

Argoverse 2

模型全部性能数据

MobileNetv1

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 1.14
  • FPS: 4753.30
  • ITC(ms): 0.480
  • TCPP(ms): 0.034
  • RV(mb): 4.56
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7374(FLOAT)/0.7298(INT8)

MobileNetv2

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 0.63
  • FPS: 4706.60
  • ITC(ms): 0.505
  • TCPP(ms): 0.035
  • RV(mb): 3.95
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7217(FLOAT)/0.7147(INT8)

ResNet50

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 7.72
  • FPS: 1131.00
  • ITC(ms): 1.182
  • TCPP(ms): 0.035
  • RV(mb): 26.08
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7703(FLOAT)/0.7678(INT8)

GoogleNet

EfficientNet_Lite0

EfficientNet_Lite1

EfficientNet_Lite2

EfficientNet_Lite3

EfficientNet_Lite4

Vargconvnet

Efficientnasnet_m

Efficientnasnet_s

ResNet18

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 3.63
  • FPS: 2542.60
  • ITC(ms): 0.683
  • TCPP(ms): 0.034
  • RV(mb): 11.87
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7169(FLOAT)/0.7164(INT8)

YOLOv2_Darknet19

  • INPUT SIZE: 1x3x608x608
  • C(GOPs): 62.94
  • FPS: 225.31
  • ITC(ms): 4.753
  • TCPP(ms): 0.304
  • RV(mb): 52.24
  • WV(mb): 1.16
  • Dataset: COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.2760(FLOAT)/0.2700(INT8)
  • LINKS: https://pjreddie.com/darknet/yolo

YOLOv3_Darknet53

  • INPUT SIZE: 1x3x416x416
  • C(GOPs): 65.86
  • FPS: 209.30
  • ITC(ms): 5.161
  • TCPP(ms): 1.714
  • RV(mb): 67.06
  • WV(mb): 8.00
  • Dataset: COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3370(FLOAT)/0.3360(INT8)
  • LINKS: https://github.com/ChenYingpeng/caffe-yolov3/

YOLOv5x_v2.0

SSD_MobileNetv1

  • INPUT SIZE: 1x3x300x300
  • C(GOPs): 2.30
  • FPS: 2975.60
  • ITC(ms): 0.709
  • TCPP(ms): 0.197
  • RV(mb): 6.28
  • WV(mb): 0.25
  • Dataset: VOC
  • ACCURACY: mAP: 0.7345(FLOAT)/0.7269(INT8)
  • LINKS: https://github.com/chuanqi305/MobileNet-SSD

Centernet_resnet101

YOLOv3_VargDarknet

Deeplabv3plus_efficientnetb0

Fastscnn_efficientnetb0

Deeplabv3plus_efficientnetm1

Deeplabv3plus_efficientnetm2

Bev_gkt_mixvargenet_multitask

  • INPUT SIZE: image: 6x3x512x960 points(0-8): 6x64x64x2
  • C(GOPs): 207.16
  • FPS: 63.33
  • ITC(ms): 16.989
  • TCPP(ms): 5.490
  • RV(mb): 123.38
  • WV(mb): 109.48
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.2810(FLOAT)/0.2787(INT8) MeanIOU: 0.4852(FLOAT)/0.4835(INT8) mAP: 0.1991(FLOAT)/0.1992(INT8)

Bev_ipm_4d_efficientnetb0_multitask

  • INPUT SIZE: image: 6x3x512x960 points: 6x128x128x2 prev_feat: 1x164x28x128 prev_point: 1x128x128x2
  • C(GOPs): 53.58
  • FPS: 108.49
  • ITC(ms): 10.699
  • TCPP(ms): 5.494
  • RV(mb): 69.83
  • WV(mb): 56.30
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3721(FLOAT)/0.3735(INT8) MeanIOU: 0.5287(FLOAT)/0.5387(INT8) mAP: 0.2200(FLOAT)/0.2217(INT8)

Bev_ipm_efficientnetb0_multitask

  • INPUT SIZE: image: 6x3x512x960 points: 6x128x128x2
  • C(GOPs): 52.97
  • FPS: 112.13
  • ITC(ms): 9.996
  • TCPP(ms): 5.468
  • RV(mb): 66.52
  • WV(mb): 54.21
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3056(FLOAT)/0.3029(INT8) MeanIOU: 0.5145(FLOAT)/0.5098(INT8) mAP: 0.2170(FLOAT)/0.2163(INT8)

Bev_lss_efficientnetb0_multitask

  • INPUT SIZE: image: 6x3x256x704 points(0&1): 10x128x128x2
  • C(GOPs): 24.06
  • FPS: 178.75
  • ITC(ms): 6.670
  • TCPP(ms): 5.438
  • RV(mb): 26.98
  • WV(mb): 20.48
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3007(FLOAT)/0.3017(INT8) MeanIOU: 0.5180(FLOAT)/0.5147(INT8) mAP: 0.2062(FLOAT)/0.2050(INT8)

Detr3d_efficientnetb3

  • INPUT SIZE: coords(0-3): 6x4x256x2 image: 6x3x512x1408 masks: 1x4x256x24
  • C(GOPs): 227.71
  • FPS: 29.45
  • ITC(ms): 34.624
  • TCPP(ms): 1.117
  • RV(mb): 376.75
  • WV(mb): 228.92
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3304(FLOAT)/0.3279(INT8) mAP: 0.2752(FLOAT)/0.2703(INT8)

Petr_efficientnetb3

  • INPUT SIZE: image: 6x3x512x1408 pos_embed: 1x96x44x256
  • C(GOPs): 219.17
  • FPS: 19.02
  • ITC(ms): 53.187
  • TCPP(ms): 1.130
  • RV(mb): 260.48
  • WV(mb): 149.67
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3765(FLOAT)/0.3741(INT8) mAP: 0.3038(FLOAT)/0.2934(INT8)

Bevformer_tiny_resnet50_detection

  • INPUT SIZE: img: 6x3x480x800 prev_bev: 1x2500x256 prev_bev_ref: 1x50x50x2 queries_rebatch_grid: 6x20x32x2 restore_bev_grid: 1x100x50x2 reference_points_rebatch: 6x640x4x2 bev_pillar_counts: 1x2500x1
  • C(GOPs): 387.29
  • FPS: 28.84
  • ITC(ms): 44.573
  • TCPP(ms): 1.405
  • RV(mb): 291.43
  • WV(mb): 195.32
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.3713(FLOAT)/0.3679(INT8) mAP: 0.2673(FLOAT)/0.2614(INT8)

Flashocc_henet_lss_occ3d_nuscenes

  • INPUT SIZE: img: 6x3x512x960 points: 10x128x128x2 points_depth: 10x128x128x2
  • C(GOPs): 126.75
  • FPS: 89.10
  • ITC(ms): 12.299
  • TCPP(ms): 40.297
  • RV(mb): 83.91
  • WV(mb): 68.93
  • Dataset: Nuscenes
  • ACCURACY: mIoU: 0.3674(FLOAT)/0.3642(INT8)

Horizon_swin_transformer

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 8.98
  • FPS: 291.91
  • ITC(ms): 3.730
  • TCPP(ms): 0.034
  • RV(mb): 47.17
  • WV(mb): 6.31
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.8024(FLOAT)/0.7947(INT8)

Mixvargenet

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 2.07
  • FPS: 4935.20
  • ITC(ms): 0.488
  • TCPP(ms): 0.034
  • RV(mb): 2.51
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7075(FLOAT)/0.7063(INT8)

Vargnetv2

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 0.72
  • FPS: 4254.40
  • ITC(ms): 0.535
  • TCPP(ms): 0.035
  • RV(mb): 4.68
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7342(FLOAT)/0.7317(INT8)

Vit_small

  • INPUT SIZE: 1x3x224x224
  • C(GOPs): 9.20
  • FPS: 533.30
  • ITC(ms): 2.174
  • TCPP(ms): 0.034
  • RV(mb): 26.12
  • WV(mb): 0.0041
  • Dataset: ImageNet
  • ACCURACY: Top1: 0.7950(FLOAT)/0.7927(INT8)

Centerpoint_pointpillar

  • INPUT SIZE: points: 300000x5 voxel_feature: 1x5x20x40000 coors: 40000x4
  • C(GOPs): 127.73
  • FPS: 89.97
  • ITC(ms): 60.183
  • TCPP(ms): 13.971
  • RV(mb): 49.11
  • WV(mb): 24.78
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.5832(FLOAT)/0.5819(INT8) mAP: 0.4804(FLOAT)/0.4780(INT8)

Detr_efficientnetb3

  • INPUT SIZE: 1x3x800x1333
  • C(GOPs): 67.39
  • FPS: 53.59
  • ITC(ms): 19.033
  • TCPP(ms): 0.345
  • RV(mb): 278.29
  • WV(mb): 153.76
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3721(FLOAT)/0.3605(INT8)

Detr_resnet50

  • INPUT SIZE: 1x3x800x1333
  • C(GOPs): 203.07
  • FPS: 39.75
  • ITC(ms): 25.549
  • TCPP(ms): 0.345
  • RV(mb): 409.13
  • WV(mb): 270.43
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3569(FLOAT)/0.3142(INT8)

FCOS3D_efficientnetb0

  • INPUT SIZE: 1x3x512x896
  • C(GOPs): 19.94
  • FPS: 426.75
  • ITC(ms): 3.405
  • TCPP(ms): 2.740
  • RV(mb): 11.50
  • WV(mb): 4.14
  • Dataset: nuscenes
  • ACCURACY: NDS: 0.3061(FLOAT)/0.3029(INT8) mAP: 0.2133(FLOAT)/0.2079(INT8)

Fcos_efficientnetb0

  • INPUT SIZE: 1x3x512x512
  • C(GOPs): 5.02
  • FPS: 1043.50
  • ITC(ms): 1.931
  • TCPP(ms): 0.136
  • RV(mb): 6.51
  • WV(mb): 2.78
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.3626(FLOAT)/0.3565(INT8)

Ganet_mixvargenet

  • INPUT SIZE: 1x3x320x800
  • C(GOPs): 10.74
  • FPS: 1478.00
  • ITC(ms): 1.013
  • TCPP(ms): 0.211
  • RV(mb): 2.18
  • WV(mb): 0.53
  • Dataset: CuLane
  • ACCURACY: F1Score: 0.7949(FLOAT)/0.7881(INT8)

Keypoint_efficientnetb0

  • INPUT SIZE: 1x3x128x128
  • C(GOPs): 0.45
  • FPS: 4697.00
  • ITC(ms): 0.491
  • TCPP(ms): 0.071
  • RV(mb): 4.62
  • WV(mb): 0.01
  • Dataset: Carfusion
  • ACCURACY: PCK(alpha=0.1): 0.9433(FLOAT)/0.9432(INT8)

Pointpillars_kitti_car

  • INPUT SIZE: 150000x4
  • C(GOPs): 66.82
  • FPS: 23.73
  • ITC(ms): 229.510
  • TCPP(ms): 0.537
  • RV(mb): 49.90
  • WV(mb): 30.04
  • Dataset: Kitti3d
  • ACCURACY: APDet= 0.7733(FLOAT)/0.7676(INT8)

Deformable_detr_resnet50

  • INPUT SIZE: 1x3x800x1333
  • C(GOPs): 408.94
  • FPS: 4.76
  • ITC(ms): 210.470
  • TCPP(ms): 15.570
  • RV(mb): 3830.91
  • WV(mb): 2918.69
  • Dataset: MS COCO
  • ACCURACY: [IoU=0.50:0.95]= 0.4414(FLOAT)/0.4204(INT8)

Stereonetplus_mixvargenet

  • INPUT SIZE: 2x3x544x960
  • C(GOPs): 48.57
  • FPS: 208.93
  • ITC(ms): 5.219
  • TCPP(ms): 1.960
  • RV(mb): 38.97
  • WV(mb): 34.60
  • Dataset: SceneFlow
  • ACCURACY: EPE: 1.1270(FLOAT)/1.1342(INT8)

Centerpoint_mixvargnet_multitask

  • INPUT SIZE: points: 300000x5 voxel_feature: 1x5x20x40000 coors: 40000x4
  • C(GOPs): 51.45
  • FPS: 90.59
  • ITC(ms): 57.678
  • TCPP(ms): 12.097
  • RV(mb): 32.41
  • WV(mb): 16.79
  • Dataset: Nuscenes
  • ACCURACY: NDS: 0.5809(FLOAT)/0.5754(INT8) MeanIOU: 0.9128(FLOAT)/0.9121(INT8) mAP: 0.4726(FLOAT)/0.4629(INT8)

Unet_mobilenetv1

  • INPUT SIZE: 1x3x1024x2048
  • C(GOPs): 7.36
  • FPS: 780.85
  • ITC(ms): 1.728
  • TCPP(ms): 0.148
  • RV(mb): 14.85
  • WV(mb): 9.57
  • Dataset: Cityscapes
  • ACCURACY: mIoU: 0.6802(FLOAT)/0.6757(INT8)

Motr_efficientnetb3

  • INPUT SIZE: image: 1x800x1422x3 track_query: 1x2x128x156 ref_points: 1x2x128x4 mask_query: 1x1x256x1
  • C(GOPs): 64.43
  • FPS: 71.27
  • ITC(ms): 14.111
  • TCPP(ms): 5.135
  • RV(mb): 120.39
  • WV(mb): 40.80
  • Dataset: Mot17
  • ACCURACY: MOTA: 0.5805(FLOAT)/0.5728(INT8)

Densetnt_vectornet

  • INPUT SIZE: goals_2d: 30x1x2048x2 goals_2d_mask: 30x1x2048x1 instance_mask: 30x1x96x1 lane_feat: 30x9x64x11 traj_feat: 30x19x32x9
  • C(GOPs): 12.50
  • FPS: 155.06
  • ITC(ms): 11.607
  • TCPP(ms): 2.302
  • RV(mb): 61.68
  • WV(mb): 41.81
  • Dataset: Argoverse 1
  • ACCURACY: minFDA: 1.2975(FLOAT)/1.3058(INT8)

Maptroe_henet_tinym_bevformer

  • INPUT SIZE: img: 6x3x480x800 osm_mask: 1x1x50x100 queries_rebatch_grid: 6x20x100x2 restore_bev_grid: 1x100x100x2 reference_points_rebatch: 6x2000x4x2 bev_pillar_counts: 1x5000x1
  • C(GOPs): 134.57
  • FPS: 67.78
  • ITC(ms): 15.350
  • TCPP(ms): 0.254
  • RV(mb): 155.95
  • WV(mb): 70.67
  • Dataset: Nuscenes
  • ACCURACY: mAP: 0.6633(FLOAT)/0.6509(INT8)

Qcnet_oe

  • INPUT SIZE: valid_mask: 1x30x10 valid_mask_a2a: 1x10x30x30 agent_type: 1x30x1 x_a_cur: 1x1x30x1,1x1x30x1,1x1x30x1,1x1x30x1 r_pl2a_cur: 1x1x30x80,1x1x30x80,1x1x30x80 r_t_cur: 1x1x30x6,1x1x30x6,1x1x30x6,1x1x30x6 r_a2a_cur: 1x1x30x30,1x1x30x30,1x1x30x30 x_a_mid_emb: 1x30x2x128 x_a: 1x30x6x128 pl_type,is_intersection: 1x80 r_pl2pl: 1x1x80x80,1x1x80x80,1x1x80x80 r_pt2pl: 1x1x80x50,1x1x80x50,1x1x80x50 mask_pl2pl: 1x80x80 magnitude,pt_type,side,mask: 1x80x50 mask_a2m: 1x30x30 mask_dst: 1x30x1 type_pl2pl: 1x80x80
  • C(GOPs): 7.85
  • FPS: 201.85
  • ITC(ms): 12.935
  • TCPP(ms): 0.822
  • RV(mb): 48.28
  • WV(mb): 25.99
  • Dataset: Argoverse 2
  • ACCURACY: hitrate: 0.8026(FLOAT)/0.7906(INT8)