EdgeTAM: Optimized for Qualcomm Devices
EdgeTAM is a lightweight and efficient version of SAM 2, optimized for on-device tracking and segmenting any object in videos and low memory usage by using a novel 2D Spatial Perceiver and RepViT backbone.
This is based on the implementation of EdgeTAM found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
There are two ways to deploy this model on your device:
Option 1: Download Pre-Exported Models
Below are pre-exported model assets ready for deployment.
| Runtime | Precision | Chipset | SDK Versions | Download |
|---|---|---|---|---|
| ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | Download |
| ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | Download |
| QNN_DLC | float | Universal | QAIRT 2.45 | Download |
| TFLITE | float | Universal | QAIRT 2.45 | Download |
| TFLITE | w8a8 | Universal | QAIRT 2.45 | Download |
For more device-specific assets and performance metrics, visit EdgeTAM on Qualcomm® AI Hub.
Option 2: Export with Custom Configurations
Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
This option is ideal if you need to customize the model beyond the default configuration provided here.
See our repository for EdgeTAM on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.semantic_segmentation
Model Stats:
- Model checkpoint: edgetam.pt
- Input resolution (Encoder): 1024x1024
- Number of parameters (encoder): 8.3M
- Model size (encoder) (float): 33 MB
- Number of parameters (memory_encoder): 1.2M
- Model size (memory_encoder) (float): 4.6 MB
- Number of parameters (video_decoder): 6.22M
- Model size (video_decoder) (float): 23.7 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| encoder | ONNX | float | Snapdragon® X2 Elite | 8.815 ms | 200 - 200 MB | NPU |
| encoder | ONNX | float | Snapdragon® X Elite | 18.005 ms | 137 - 137 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 14.208 ms | 56 - 397 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 90.694 ms | 55 - 461 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 17.969 ms | 48 - 52 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS8450 | 90.694 ms | 55 - 461 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 9.502 ms | 46 - 359 MB | NPU |
| encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.826 ms | 46 - 377 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS9075 | 27.078 ms | 12 - 69 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS8750 | 9.502 ms | 46 - 359 MB | NPU |
| encoder | ONNX | float | Qualcomm® QCS7181 | 18.005 ms | 137 - 137 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 3.172 ms | 210 - 210 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® X Elite | 8.286 ms | 179 - 179 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.334 ms | 1 - 290 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2254.343 ms | 4 - 313 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS6490 | 3161.085 ms | 3 - 48 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 7.866 ms | 9 - 22 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 2254.343 ms | 4 - 313 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.063 ms | 2 - 277 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 10.649 ms | 14 - 270 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCM6690 | 50.02 ms | 5 - 254 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS9075 | 8.45 ms | 9 - 58 MB | NPU |
| encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.47 ms | 12 - 273 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS7790 | 10.649 ms | 14 - 270 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS8750 | 4.47 ms | 12 - 273 MB | NPU |
| encoder | ONNX | w8a8 | Qualcomm® QCS7181 | 8.286 ms | 179 - 179 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.366 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® X Elite | 23.942 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 16.695 ms | 0 - 336 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 99.777 ms | 10 - 420 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8275 | 68.796 ms | 0 - 259 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 23.356 ms | 4 - 6 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8450 | 99.777 ms | 10 - 420 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 11.672 ms | 12 - 290 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA8295P | 53.644 ms | 0 - 336 MB | NPU |
| encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.78 ms | 2 - 303 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® SA7255P | 68.796 ms | 0 - 259 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS9075 | 33.744 ms | 12 - 46 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS8750 | 11.672 ms | 12 - 290 MB | NPU |
| encoder | QNN_DLC | float | Qualcomm® QCS7181 | 23.942 ms | 12 - 12 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 4.379 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 11.562 ms | 3 - 3 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 7.37 ms | 3 - 304 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2268.244 ms | 3 - 327 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 3209.718 ms | 3 - 12 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 20.181 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 10.854 ms | 3 - 11 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2268.244 ms | 3 - 327 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.783 ms | 3 - 268 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 11.417 ms | 3 - 264 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 88.26 ms | 5 - 237 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 13.24 ms | 1 - 11 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 20.181 ms | 3 - 260 MB | NPU |
| encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 4.532 ms | 3 - 251 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2132.445 ms | 1 - 280 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 11.417 ms | 3 - 264 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 4.532 ms | 3 - 251 MB | NPU |
| encoder | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 11.562 ms | 3 - 3 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 16.704 ms | 20 - 370 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 99.473 ms | 0 - 418 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8275 | 68.799 ms | 20 - 287 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 23.073 ms | 20 - 23 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8450 | 99.473 ms | 0 - 418 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 11.644 ms | 19 - 306 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA8295P | 53.519 ms | 20 - 365 MB | NPU |
| encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 8.83 ms | 20 - 322 MB | NPU |
| encoder | TFLITE | float | Qualcomm® SA7255P | 68.799 ms | 20 - 287 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS9075 | 33.861 ms | 0 - 46 MB | NPU |
| encoder | TFLITE | float | Qualcomm® QCS8750 | 11.644 ms | 19 - 306 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.808 ms | 4 - 301 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2255.058 ms | 2 - 326 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS6490 | 3249.978 ms | 0 - 23 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8275 | 13.742 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 7.01 ms | 5 - 7 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 2255.058 ms | 2 - 326 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.648 ms | 0 - 262 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 8.187 ms | 4 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 69.22 ms | 5 - 236 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS9075 | 7.917 ms | 4 - 20 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 13.742 ms | 5 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 2.978 ms | 3 - 248 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 2107.898 ms | 1 - 281 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS7790 | 8.187 ms | 4 - 260 MB | NPU |
| encoder | TFLITE | w8a8 | Qualcomm® QCS8750 | 2.978 ms | 3 - 248 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X2 Elite | 10.461 ms | 205 - 205 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® X Elite | 24.954 ms | 141 - 141 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 19.714 ms | 8 - 437 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 40.033 ms | 8 - 324 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 25.067 ms | 8 - 18 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS8450 | 40.033 ms | 8 - 324 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 10.796 ms | 0 - 284 MB | NPU |
| memory_encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.729 ms | 2 - 291 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS9075 | 26.201 ms | 8 - 53 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS8750 | 10.796 ms | 0 - 284 MB | NPU |
| memory_encoder | ONNX | float | Qualcomm® QCS7181 | 24.954 ms | 141 - 141 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 2.984 ms | 211 - 211 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® X Elite | 6.15 ms | 180 - 180 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 3.902 ms | 1 - 205 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 11.32 ms | 2 - 333 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS6490 | 19.691 ms | 0 - 47 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 5.815 ms | 1 - 6 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS8450 | 11.32 ms | 2 - 333 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.693 ms | 0 - 294 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 7.092 ms | 2 - 280 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCM6690 | 33.519 ms | 2 - 323 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS9075 | 7.34 ms | 1 - 47 MB | NPU |
| memory_encoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 4.23 ms | 2 - 298 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS7790 | 7.092 ms | 2 - 280 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS8750 | 4.23 ms | 2 - 298 MB | NPU |
| memory_encoder | ONNX | w8a8 | Qualcomm® QCS7181 | 6.15 ms | 180 - 180 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X2 Elite | 10.247 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® X Elite | 19.818 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 13.424 ms | 2 - 533 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 29.667 ms | 4 - 404 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8275 | 44.867 ms | 2 - 317 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 18.829 ms | 8 - 17 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8450 | 29.667 ms | 4 - 404 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 10.598 ms | 0 - 319 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA8295P | 23.505 ms | 0 - 366 MB | NPU |
| memory_encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.185 ms | 3 - 314 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® SA7255P | 44.867 ms | 2 - 317 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS9075 | 26.708 ms | 10 - 20 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS8750 | 10.598 ms | 0 - 319 MB | NPU |
| memory_encoder | QNN_DLC | float | Qualcomm® QCS7181 | 19.818 ms | 8 - 8 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 3.036 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 6.749 ms | 2 - 2 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 4.092 ms | 0 - 240 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 7.91 ms | 0 - 199 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 18.217 ms | 1 - 5 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 11.379 ms | 2 - 167 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 6.051 ms | 2 - 5 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 7.91 ms | 0 - 199 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 2.594 ms | 1 - 189 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 7.418 ms | 1 - 352 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 47.733 ms | 2 - 323 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 7.05 ms | 2 - 6 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 11.379 ms | 2 - 167 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 3.103 ms | 1 - 173 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 7.969 ms | 2 - 182 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 7.418 ms | 1 - 352 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 3.103 ms | 1 - 173 MB | NPU |
| memory_encoder | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 6.749 ms | 2 - 2 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 19.641 ms | 0 - 485 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 38.033 ms | 0 - 329 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8275 | 53.142 ms | 0 - 315 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 24.705 ms | 0 - 21 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8450 | 38.033 ms | 0 - 329 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 13.526 ms | 0 - 316 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA8295P | 30.196 ms | 0 - 286 MB | NPU |
| memory_encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 9.832 ms | 0 - 315 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® SA7255P | 53.142 ms | 0 - 315 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS9075 | 26.855 ms | 0 - 16 MB | NPU |
| memory_encoder | TFLITE | float | Qualcomm® QCS8750 | 13.526 ms | 0 - 316 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 6.405 ms | 1 - 253 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 13.255 ms | 1 - 257 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS6490 | 105.093 ms | 10 - 52 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8275 | 17.78 ms | 1 - 227 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 8.851 ms | 1 - 3 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 13.255 ms | 1 - 257 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.979 ms | 1 - 240 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 32.642 ms | 10 - 195 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 70.637 ms | 10 - 235 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS9075 | 12.312 ms | 1 - 9 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 17.78 ms | 1 - 227 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 4.737 ms | 1 - 222 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 12.283 ms | 1 - 230 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS7790 | 32.642 ms | 10 - 195 MB | NPU |
| memory_encoder | TFLITE | w8a8 | Qualcomm® QCS8750 | 4.737 ms | 1 - 222 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X2 Elite | 3.395 ms | 196 - 196 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® X Elite | 7.423 ms | 165 - 165 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.089 ms | 17 - 270 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 15.41 ms | 17 - 259 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 7.233 ms | 16 - 20 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS8450 | 15.41 ms | 17 - 259 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite Mobile | 3.998 ms | 1 - 216 MB | NPU |
| video_decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.487 ms | 3 - 220 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS9075 | 8.835 ms | 16 - 61 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS8750 | 3.998 ms | 1 - 216 MB | NPU |
| video_decoder | ONNX | float | Qualcomm® QCS7181 | 7.423 ms | 165 - 165 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 1.634 ms | 209 - 209 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® X Elite | 3.622 ms | 178 - 178 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 2.298 ms | 4 - 215 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 4.288 ms | 4 - 160 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS6490 | 14.298 ms | 4 - 49 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 3.472 ms | 1 - 13 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS8450 | 4.288 ms | 4 - 160 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.542 ms | 0 - 156 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 4.218 ms | 4 - 301 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCM6690 | 19.506 ms | 2 - 255 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS9075 | 4.097 ms | 0 - 49 MB | NPU |
| video_decoder | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.85 ms | 0 - 130 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS7790 | 4.218 ms | 4 - 301 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS8750 | 1.85 ms | 0 - 130 MB | NPU |
| video_decoder | ONNX | w8a8 | Qualcomm® QCS7181 | 3.622 ms | 178 - 178 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.327 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® X Elite | 6.195 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 4.062 ms | 3 - 248 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 9.172 ms | 2 - 227 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8275 | 13.509 ms | 16 - 238 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5.905 ms | 16 - 25 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8450 | 9.172 ms | 2 - 227 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.172 ms | 4 - 220 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA8295P | 8.821 ms | 0 - 201 MB | NPU |
| video_decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.81 ms | 4 - 201 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® SA7255P | 13.509 ms | 16 - 238 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS9075 | 7.193 ms | 16 - 34 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS8750 | 3.172 ms | 4 - 220 MB | NPU |
| video_decoder | QNN_DLC | float | Qualcomm® QCS7181 | 6.195 ms | 16 - 16 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.763 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 3.352 ms | 4 - 4 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.924 ms | 4 - 122 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.47 ms | 0 - 116 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 10.429 ms | 1 - 7 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 5.536 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 2.885 ms | 4 - 6 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 3.47 ms | 0 - 116 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 1.315 ms | 1 - 115 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.468 ms | 4 - 218 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 13.616 ms | 4 - 280 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 3.327 ms | 0 - 6 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 5.536 ms | 4 - 92 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.525 ms | 1 - 93 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 4.06 ms | 4 - 91 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 3.468 ms | 4 - 218 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 1.525 ms | 1 - 93 MB | NPU |
| video_decoder | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 3.352 ms | 4 - 4 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 4.043 ms | 0 - 246 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 9.385 ms | 0 - 231 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8275 | 13.387 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.936 ms | 0 - 8 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8450 | 9.385 ms | 0 - 231 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 3.244 ms | 0 - 208 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA8295P | 8.719 ms | 0 - 238 MB | NPU |
| video_decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.831 ms | 0 - 193 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® SA7255P | 13.387 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS9075 | 7.237 ms | 0 - 31 MB | NPU |
| video_decoder | TFLITE | float | Qualcomm® QCS8750 | 3.244 ms | 0 - 208 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 5.928 ms | 0 - 249 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 9.759 ms | 0 - 247 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS6490 | 33.723 ms | 14 - 61 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8275 | 15.417 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 7.527 ms | 0 - 33 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8450 | 9.759 ms | 0 - 247 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 3.374 ms | 0 - 249 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 15.013 ms | 12 - 204 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 35.165 ms | 13 - 213 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS9075 | 9.745 ms | 0 - 14 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 15.417 ms | 0 - 215 MB | NPU |
| video_decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 3.896 ms | 0 - 246 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 9.273 ms | 0 - 222 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS7790 | 15.013 ms | 12 - 204 MB | NPU |
| video_decoder | TFLITE | w8a8 | Qualcomm® QCS8750 | 3.896 ms | 0 - 246 MB | NPU |
License
- The license for the original implementation of EdgeTAM can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
