Yolo-v7: Optimized for Qualcomm Devices

YoloV7 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of Yolo-v7 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for Yolo-v7 on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Input resolution: 640x640
  • Model checkpoint: YoloV7 Tiny
  • Model size (float): 23.8 MB
  • Model size (w8a16): 6.66 MB
  • Model size (w8a8): 6.23 MB
  • Number of parameters: 6.24M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
Yolo-v7 ONNX float Snapdragon® X2 Elite 5.824 ms 5 - 5 MB NPU
Yolo-v7 ONNX float Snapdragon® X Elite 10.714 ms 8 - 8 MB NPU
Yolo-v7 ONNX float Snapdragon® 8 Gen 3 Mobile 7.676 ms 6 - 192 MB NPU
Yolo-v7 ONNX float Snapdragon® 8 Gen 1 Mobile 17.741 ms 6 - 196 MB NPU
Yolo-v7 ONNX float Qualcomm® Dragonwing™ IQ-8275 11.95 ms 5 - 8 MB NPU
Yolo-v7 ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 10.665 ms 0 - 103 MB NPU
Yolo-v7 ONNX float Qualcomm® QCS8450 17.741 ms 6 - 196 MB NPU
Yolo-v7 ONNX float Qualcomm® Dragonwing™ IQ-9075 12.435 ms 5 - 7 MB NPU
Yolo-v7 ONNX float Qualcomm® Dragonwing™ IQ-X7181 10.714 ms 8 - 8 MB NPU
Yolo-v7 ONNX float Qualcomm® Dragonwing™ Q-8750 6.561 ms 1 - 173 MB NPU
Yolo-v7 ONNX float Snapdragon® 8 Elite Mobile 6.561 ms 1 - 173 MB NPU
Yolo-v7 ONNX float Snapdragon® 8 Elite Gen 5 Mobile 5.923 ms 1 - 174 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® X2 Elite 2.002 ms 2 - 2 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® X Elite 4.745 ms 4 - 4 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 2.915 ms 0 - 214 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 7.318 ms 3 - 220 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 17.564 ms 2 - 5 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ IQ-8275 4.109 ms 2 - 6 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 4.494 ms 0 - 115 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® QCS8450 7.318 ms 3 - 220 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 4.924 ms 2 - 5 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 4.745 ms 4 - 4 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ Q-6690 36.038 ms 3 - 221 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ Q-7790 5.555 ms 3 - 188 MB NPU
Yolo-v7 ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 2.221 ms 1 - 189 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 8 Elite Mobile 2.221 ms 1 - 189 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 1.764 ms 0 - 195 MB NPU
Yolo-v7 ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 5.555 ms 3 - 188 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® X2 Elite 1.076 ms 1 - 1 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® X Elite 2.449 ms 5 - 5 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 1.524 ms 0 - 80 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 3.223 ms 0 - 80 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 8.312 ms 1 - 4 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 2.347 ms 0 - 4 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 2.332 ms 0 - 9 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® QCS8450 3.223 ms 0 - 80 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 2.568 ms 0 - 3 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 2.449 ms 5 - 5 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 15.86 ms 2 - 175 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 3.45 ms 2 - 172 MB NPU
Yolo-v7 ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 1.229 ms 0 - 55 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® 8 Elite Mobile 1.229 ms 0 - 55 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.985 ms 0 - 62 MB NPU
Yolo-v7 ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 3.45 ms 2 - 172 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® X2 Elite 6.302 ms 5 - 5 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® X Elite 10.032 ms 5 - 5 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® 8 Gen 3 Mobile 6.94 ms 5 - 183 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® 8 Gen 1 Mobile 16.201 ms 5 - 184 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 10.709 ms 5 - 12 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 23.343 ms 0 - 154 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 9.35 ms 5 - 6 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA8775P 11.48 ms 0 - 158 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA8650P 11.48 ms 0 - 158 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA8255P 11.48 ms 0 - 158 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® QCS8450 16.201 ms 5 - 184 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 11.458 ms 5 - 11 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 10.032 ms 5 - 5 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® Dragonwing™ Q-8750 6.333 ms 0 - 155 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA7255P 23.343 ms 0 - 154 MB NPU
Yolo-v7 QNN_DLC float Qualcomm® SA8295P 13.37 ms 1 - 153 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® 8 Elite Mobile 6.333 ms 0 - 155 MB NPU
Yolo-v7 QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 5.642 ms 5 - 166 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® X2 Elite 1.985 ms 2 - 2 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® X Elite 4.019 ms 2 - 2 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 2.532 ms 2 - 192 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 5.716 ms 2 - 202 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 15.319 ms 4 - 8 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 3.589 ms 2 - 7 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-8275 8.628 ms 2 - 167 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.591 ms 2 - 78 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA8775P 4.338 ms 1 - 167 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA8650P 4.338 ms 1 - 167 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA8255P 4.338 ms 1 - 167 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® QCS8450 5.716 ms 2 - 202 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 3.969 ms 4 - 8 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 4.019 ms 2 - 2 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 32.59 ms 2 - 170 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 4.823 ms 2 - 172 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 1.888 ms 0 - 164 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA7255P 8.628 ms 2 - 167 MB NPU
Yolo-v7 QNN_DLC w8a16 Qualcomm® SA8295P 5.254 ms 0 - 170 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 1.888 ms 0 - 164 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 1.558 ms 2 - 174 MB NPU
Yolo-v7 QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 4.823 ms 2 - 172 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® X2 Elite 0.984 ms 1 - 1 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® X Elite 2.313 ms 1 - 1 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 1.323 ms 24 - 81 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 2.792 ms 1 - 62 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 8.571 ms 1 - 4 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 1.916 ms 1 - 5 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 4.366 ms 1 - 41 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 2.047 ms 0 - 10 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA8775P 2.393 ms 0 - 41 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA8650P 2.393 ms 0 - 41 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA8255P 2.393 ms 0 - 41 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® QCS8450 2.792 ms 1 - 62 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 2.15 ms 3 - 6 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 2.313 ms 1 - 1 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 14.088 ms 1 - 160 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 3.344 ms 1 - 158 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 1.027 ms 1 - 44 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA7255P 4.366 ms 1 - 41 MB NPU
Yolo-v7 QNN_DLC w8a8 Qualcomm® SA8295P 3.338 ms 1 - 38 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 1.027 ms 1 - 44 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.776 ms 1 - 40 MB NPU
Yolo-v7 QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 3.344 ms 1 - 158 MB NPU
Yolo-v7 TFLITE float Snapdragon® 8 Gen 3 Mobile 6.981 ms 1 - 190 MB NPU
Yolo-v7 TFLITE float Snapdragon® 8 Gen 1 Mobile 16.159 ms 0 - 187 MB NPU
Yolo-v7 TFLITE float Qualcomm® Dragonwing™ IQ-8275 10.787 ms 1 - 21 MB NPU
Yolo-v7 TFLITE float Qualcomm® Dragonwing™ IQ-8275 23.588 ms 1 - 158 MB NPU
Yolo-v7 TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 9.356 ms 1 - 3 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA8775P 11.523 ms 1 - 163 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA8650P 11.523 ms 1 - 163 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA8255P 11.523 ms 1 - 163 MB NPU
Yolo-v7 TFLITE float Qualcomm® QCS8450 16.159 ms 0 - 187 MB NPU
Yolo-v7 TFLITE float Qualcomm® Dragonwing™ IQ-9075 12.736 ms 1 - 20 MB NPU
Yolo-v7 TFLITE float Qualcomm® Dragonwing™ Q-8750 6.32 ms 0 - 160 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA7255P 23.588 ms 1 - 158 MB NPU
Yolo-v7 TFLITE float Qualcomm® SA8295P 13.414 ms 1 - 158 MB NPU
Yolo-v7 TFLITE float Snapdragon® 8 Elite Mobile 6.32 ms 0 - 160 MB NPU
Yolo-v7 TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 5.724 ms 1 - 167 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 1.395 ms 0 - 62 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 2.988 ms 0 - 67 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 8.309 ms 0 - 10 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 2.061 ms 0 - 10 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 4.616 ms 0 - 43 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 2.071 ms 0 - 2 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA8775P 2.565 ms 0 - 62 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA8650P 2.565 ms 0 - 62 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA8255P 2.565 ms 0 - 62 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® QCS8450 2.988 ms 0 - 67 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 2.308 ms 0 - 9 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 14.005 ms 0 - 157 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 3.494 ms 0 - 165 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 1.109 ms 0 - 70 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA7255P 4.616 ms 0 - 43 MB NPU
Yolo-v7 TFLITE w8a8 Qualcomm® SA8295P 3.612 ms 0 - 43 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 8 Elite Mobile 1.109 ms 0 - 70 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.892 ms 0 - 85 MB NPU
Yolo-v7 TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 3.494 ms 0 - 165 MB NPU

License

  • The license for the original implementation of Yolo-v7 can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/Yolo-v7