Yolo-v7: Optimized for Qualcomm Devices
YoloV7 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of Yolo-v7 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for Yolo-v7 on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Input resolution: 640x640
- Model checkpoint: YoloV7 Tiny
- Model size (float): 23.8 MB
- Model size (w8a16): 6.66 MB
- Model size (w8a8): 6.23 MB
- Number of parameters: 6.24M
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| Yolo-v7 | ONNX | float | Snapdragon® X2 Elite | 5.824 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® X Elite | 10.714 ms | 8 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.676 ms | 6 - 192 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.741 ms | 6 - 196 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 11.95 ms | 5 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.665 ms | 0 - 103 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS8450 | 17.741 ms | 6 - 196 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.435 ms | 5 - 7 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.714 ms | 8 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 6.561 ms | 1 - 173 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Mobile | 6.561 ms | 1 - 173 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.923 ms | 1 - 174 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X2 Elite | 2.002 ms | 2 - 2 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X Elite | 4.745 ms | 4 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.915 ms | 0 - 214 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 7.318 ms | 3 - 220 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 17.564 ms | 2 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 4.109 ms | 2 - 6 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 4.494 ms | 0 - 115 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS8450 | 7.318 ms | 3 - 220 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 4.924 ms | 2 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 4.745 ms | 4 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 36.038 ms | 3 - 221 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 5.555 ms | 3 - 188 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 2.221 ms | 1 - 189 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 2.221 ms | 1 - 189 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.764 ms | 0 - 195 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 5.555 ms | 3 - 188 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X2 Elite | 1.076 ms | 1 - 1 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X Elite | 2.449 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.524 ms | 0 - 80 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.223 ms | 0 - 80 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.312 ms | 1 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.347 ms | 0 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.332 ms | 0 - 9 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS8450 | 3.223 ms | 0 - 80 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.568 ms | 0 - 3 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 2.449 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 15.86 ms | 2 - 175 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.45 ms | 2 - 172 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.229 ms | 0 - 55 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.229 ms | 0 - 55 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.985 ms | 0 - 62 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.45 ms | 2 - 172 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X2 Elite | 6.302 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X Elite | 10.032 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 6.94 ms | 5 - 183 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 16.201 ms | 5 - 184 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 10.709 ms | 5 - 12 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 23.343 ms | 0 - 154 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.35 ms | 5 - 6 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8775P | 11.48 ms | 0 - 158 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8650P | 11.48 ms | 0 - 158 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8255P | 11.48 ms | 0 - 158 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS8450 | 16.201 ms | 5 - 184 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 11.458 ms | 5 - 11 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.032 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 6.333 ms | 0 - 155 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA7255P | 23.343 ms | 0 - 154 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8295P | 13.37 ms | 1 - 153 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 6.333 ms | 0 - 155 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.642 ms | 5 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 1.985 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X Elite | 4.019 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.532 ms | 2 - 192 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 5.716 ms | 2 - 202 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 15.319 ms | 4 - 8 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 3.589 ms | 2 - 7 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 8.628 ms | 2 - 167 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 3.591 ms | 2 - 78 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8775P | 4.338 ms | 1 - 167 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8650P | 4.338 ms | 1 - 167 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8255P | 4.338 ms | 1 - 167 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 5.716 ms | 2 - 202 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 3.969 ms | 4 - 8 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 4.019 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 32.59 ms | 2 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 4.823 ms | 2 - 172 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 1.888 ms | 0 - 164 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA7255P | 8.628 ms | 2 - 167 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8295P | 5.254 ms | 0 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 1.888 ms | 0 - 164 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.558 ms | 2 - 174 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4.823 ms | 2 - 172 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.984 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.313 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.323 ms | 24 - 81 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.792 ms | 1 - 62 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.571 ms | 1 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.916 ms | 1 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 4.366 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.047 ms | 0 - 10 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 2.393 ms | 0 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 2.393 ms | 0 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 2.393 ms | 0 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2.792 ms | 1 - 62 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.15 ms | 3 - 6 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 2.313 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 14.088 ms | 1 - 160 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.344 ms | 1 - 158 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.027 ms | 1 - 44 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 4.366 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 3.338 ms | 1 - 38 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.027 ms | 1 - 44 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.776 ms | 1 - 40 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.344 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 6.981 ms | 1 - 190 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 16.159 ms | 0 - 187 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 10.787 ms | 1 - 21 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 23.588 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.356 ms | 1 - 3 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8775P | 11.523 ms | 1 - 163 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8650P | 11.523 ms | 1 - 163 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8255P | 11.523 ms | 1 - 163 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS8450 | 16.159 ms | 0 - 187 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 12.736 ms | 1 - 20 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 6.32 ms | 0 - 160 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA7255P | 23.588 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8295P | 13.414 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Mobile | 6.32 ms | 0 - 160 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.724 ms | 1 - 167 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.395 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.988 ms | 0 - 67 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.309 ms | 0 - 10 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 2.061 ms | 0 - 10 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 4.616 ms | 0 - 43 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.071 ms | 0 - 2 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.565 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.565 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.565 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS8450 | 2.988 ms | 0 - 67 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.308 ms | 0 - 9 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 14.005 ms | 0 - 157 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.494 ms | 0 - 165 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.109 ms | 0 - 70 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.616 ms | 0 - 43 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.612 ms | 0 - 43 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.109 ms | 0 - 70 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.892 ms | 0 - 85 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.494 ms | 0 - 165 MB | NPU |
License
- The license for the original implementation of Yolo-v7 can be found here.
References
- YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
- Source Model Implementation
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
