Skip to content

Benchmarking.md

Latest commit

 

History

History
99 lines (72 loc) · 11.4 KB

Benchmarking.md

File metadata and controls

99 lines (72 loc) · 11.4 KB

Model Zoo

Hardware Used:

  • CPU: Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz
  • GPU: 8GB (RTX2080)

Trackers

DeepSort

Model Model Flag FPS-GPU FPS-CPU
DeepSort-ONNX-Yolov5s DEEPSORT 13 3.2
DeepSort-Pytorch-Yolov5s DEEPSORT 13 3.2

ByteTrack

Model Model Flag FPS-GPU FPS-CPU
ByteTrack-ONNX-YOLOv5s BYTETRACK 33.7 17.4
ByteTrack-Pytorch-Sample-YOLOv5s BYTETRACK 33.7 17.4

NorFair

Model Model Flag FPS-GPU FPS-CPU
tryolab-ONNX-YOLOv5s NORFAIR 25.8 12
tryolab-Pytorch-YOLOv5s NORFAIR 25.8 12

MOTPY

Model Model Flag FPS-GPU FPS-CPU
MOTPY-ONNX-YOLOv7 MOTPY 27.5 4.2
MOTPY-Pytorch-YOLOv7 MOTPY 32.4 3.5

StrongSort

Model Model Flag FPS-GPU FPS-CPU
StrongSort-ONNX-YOLOv7 STRONGSORT 7.6 3.1
StrongSort-Pytorch-YOLOv7 STRONGSORT 7.9 3.1

OCSORT

Model Model Flag FPS-GPU FPS-CPU
OCSORT-ONNX-YOLOv7 OCSORT 25.7 3.4
OCSORT-Pytorch-YOLOv7 OCSORT 31.4 3.2

Detectors

YOLOv5

PyTorch ONNX COREML
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV5X6_PYTORCH 20.8 3.69
YOLOV5S_PYTORCH 57.25 25.4
YOLOV5N_PYTORCH 68 45
YOLOV5M_PYTORCH 54 14
YOLOV5L_PYTORCH 40.06 8.28
YOLOV5X_PYTORCH 28.8 4.32
YOLOV5N6_PYTORCH 63.5 39
YOLOV5S6_PYTORCH 58 23
YOLOV5M6_PYTORCH 49 10
YOLOV5L6_PYTORCH 33 6.5
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV5X6_ONNX 2.58 2.46
YOLOV5S_ONNX 17 16.35
YOLOV5N_ONNX 57.25 35.23
YOLOV5M_ONNX 45.8 11.17
YOLOV5L_ONNX 4.07 4.36
YOLOV5X_ONNX 2.32 2.6
YOLOV5N6_ONNX 28.6 32.7
YOLOV5S6_ONNX 17 16.35
YOLOV5M6_ONNX 7.5 7.6
YOLOV5L6_ONNX 3.7 3.98
Model Name / Model Flag
YOLOV5X6_MLMODEL
YOLOV5S_MLMODEL
YOLOV5N_MLMODEL
YOLOV5M_MLMODEL
YOLOV5L_MLMODEL
YOLOV5X_MLMODEL
YOLOV5N6_MLMODEL
YOLOV5S6_MLMODEL
YOLOV5M6_MLMODEL
YOLOV5L6_MLMODEL

YOLOv6

PyTorch ONNX
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV6N_PYTORCH 65.4 35.32
YOLOV6T_PYTORCH 63 15.21
YOLOV6S_PYTORCH 49.24 20
YOLOV6M_PYTORCH 35 9.96
YOLOV6L_PYTORCH 31 6.2
YOLOV6L_RELU_PYTORCH 27 6.3
YOLOV6S_REPOPT_PYTORCH 63.5 39
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV6N_ONNX 50 30
YOLOV6T_ONNX 45.8 16
YOLOV6S_ONNX 41 13.8
YOLOV6M_ONNX 25 6.07
YOLOV6L_ONNNX 17.7 3.32
YOLOV6L_RELU_ONNX 19.15 4.36
YOLOV6S_REPOPT_ONNX 63.5 39

YOLOv7

PyTorch ONNX COREML POSE
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV7_TINY_PYTORCH 53 19
YOLOV7_PYTORCH 38 6.83
YOLOV7_X_PYTORCH 28 4.36
YOLOV7_W6_PYTORCH 32.7 7.26
YOLOV7_E6_PYTORCH 15.26 3.07
YOLOV7_D6_PYTORCH 21 3.78
YOLOV7_E6E_PYTORCH 24 3.36
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV7_TINY_ONNX 41.6 22
YOLOV7_ONNX 26 3.78
YOLOV7_X_ONNX 19.08 2.35
YOLOV7_W6_ONNX 28.6 5.2
YOLOV7_E6_ONNX 14.3 2.97
YOLOV7_D6_ONNX 18.32 2.58
YOLOV7_E6E_ONNX 15.26 2.09
Model Name / Model Flag
YOLOV7_TINY_MLMODEL
YOLOV7_MLMODEL
YOLOV7_X_MLMODEL
YOLOV7_W6_MLMODEL
YOLOV7_E6_MLMODEL
YOLOV7_D6_MLMODEL
YOLOV7_E6E_MLMODEL
Model Name / Model Flag
---
---
---
YOLOV7_W6_POSE
---
---
---

YOLOR

PyTorch ONNX
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOR_CSP_X_PYTORCH 28.6 1.83
YOLOR_CSP_X_STAR_PYTORCH 30 1.76
YOLOR_CSP_STAR_PYTORCH 38.1 2.86
YOLOR_CSP_PYTORCH 38 2.77
YOLOR_P6_PYTORCH 20 1.57
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOR_CSP_X_ONNX 15.7 2.53
YOLOR_CSP_X_STAR_ONNX 15.79 2.05
YOLOR_CSP_STAR_ONNX 18.32 3.34
YOLOR_CSP_ONNX 15.7 2.53
YOLOR_P6_ONNX 25.4 5.58

YOLOX

PyTorch ONNX
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOX_L_PYTORCH 2.58 2.31
YOLOX_NANO_PYTORCH 35 32
YOLOX_TINY_PYTORCH 25.4 25.4
YOLOX_DARKNET_PYTORCH 2 1.94
YOLOX_S_PYTORCH 9.54 9.7
YOLOX_M_PYTORCH 4.4 4.36
YOLOX_X_PYTORCH 15.64 1.39
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOX_L_ONNX 22.9 3.07
YOLOX_NANO_ONNX 59 54
YOLOX_TINY_ONNX 60 35
YOLOX_DARKNET_ONNX 24 3.36
YOLOX_S_ONNX 45 13.8
YOLOX_M_ONNX 32 6.54
YOLOX_X_ONNX 15.79 2.03

YOLOv8

PyTorch ONNX COREML POSE
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV8N_PYTORCH 26.7 17.0
YOLOV8S_PYTORCH 26.4 12.3
YOLOV8M_PYTORCH 25.1 6.8
YOLOV8L_PYTORCH 23.6 4.0
YOLOV8X_PYTORCH 20.7 2.8
Model Name / Model Flag FPS-GPU FPS-CPU
YOLOV8N_ONNX 25.1 10.5
YOLOV8S_ONNX 24.5 7.5
YOLOV8M_ONNX 22.9 4.7
YOLOV8l_ONNX 20.4 2.9
YOLOV8X_ONNX 19.0 2.0
Model Name / Model Flag
YOLOV8N_MLMODEL
YOLOV8S_MLMODEL
YOLOV8M_MLMODEL
YOLOV8L_MLMODEL
YOLOV8X_MLMODEL
Model Name / Model Flag
YOLOV8N_POSE
YOLOV8S_POSE
YOLOV8M_POSE
YOLOV8L_POSE
YOLOV8X_POSE

YOLO-NAS

Model Name/Model Flag
YOLONAS_S_PYTORCH
YOLONAS_M_PYTORCH
YOLONAS_L_PYTORCH

OCR

Model Model Flag
Craft CRAFT
dbnet18 DBNET18

Return to Installation Page