Image Segmentation
PyTorch
android

FFNet-54S: Optimized for Qualcomm Devices

FFNet-54S is a "fuss-free network" that segments street scene images with per-pixel classes like road, sidewalk, and pedestrian. Trained on the Cityscapes dataset.

This is based on the implementation of FFNet-54S found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.51, ONNX Runtime 1.30.0 Download
ONNX w8a8 Universal QAIRT 2.51, ONNX Runtime 1.30.0 Download
QNN_DLC float Universal QAIRT 2.51 Download
QNN_DLC w8a8 Universal QAIRT 2.51 Download
TFLITE float Universal QAIRT 2.51 Download
TFLITE w8a8 Universal QAIRT 2.51 Download

For more device-specific assets and performance metrics, visit FFNet-54S on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for FFNet-54S on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.semantic_segmentation

Model Stats:

  • Input resolution: 2048x1024
  • Model checkpoint: ffnet54S_dBBB_cityscapes_state_dict_quarts
  • Model size (float): 68.8 MB
  • Model size (w8a8): 17.5 MB
  • Number of output classes: 19
  • Number of parameters: 18.0M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
FFNet-54S ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 12.368 ms 5 - 214 MB NPU
FFNet-54S ONNX float Snapdragon® 8 Elite For Galaxy Mobile 16.183 ms 5 - 188 MB NPU
FFNet-54S ONNX float Snapdragon® X2 Elite 13.651 ms 24 - 24 MB NPU
FFNet-54S ONNX float Snapdragon® X Elite 31.456 ms 24 - 24 MB NPU
FFNet-54S ONNX float Snapdragon® 8 Gen 3 Mobile 26.942 ms 1 - 268 MB NPU
FFNet-54S ONNX float Snapdragon® 8 Gen 1 Mobile 47.575 ms 29 - 290 MB NPU
FFNet-54S ONNX float Qualcomm® Dragonwing™ IQ-8275 46.956 ms 24 - 52 MB NPU
FFNet-54S ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 31.067 ms 24 - 26 MB NPU
FFNet-54S ONNX float Qualcomm® QCS8450 47.575 ms 29 - 290 MB NPU
FFNet-54S ONNX float Qualcomm® Dragonwing™ IQ-9075 46.265 ms 24 - 51 MB NPU
FFNet-54S ONNX float Qualcomm® Dragonwing™ IQ-X7181 31.456 ms 24 - 24 MB NPU
FFNet-54S ONNX float Qualcomm® Dragonwing™ Q-8750 16.183 ms 5 - 188 MB NPU
FFNet-54S ONNX float Snapdragon® 8 Elite Extreme Gen 6 Mobile 12.014 ms 13 - 198 MB NPU
FFNet-54S ONNX float Snapdragon® 8 Elite Gen 6 Mobile 12.883 ms 32 - 215 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.839 ms 1 - 195 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 5.168 ms 2 - 196 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® X2 Elite 4.214 ms 7 - 7 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® X Elite 11.018 ms 13 - 13 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 6.869 ms 7 - 263 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 14.884 ms 7 - 264 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 45.681 ms 6 - 9 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 10.021 ms 6 - 10 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 10.546 ms 6 - 8 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® QCS8450 14.884 ms 7 - 264 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 11.604 ms 6 - 10 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 11.018 ms 13 - 13 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 126.978 ms 5 - 210 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 15.675 ms 7 - 216 MB NPU
FFNet-54S ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 5.168 ms 2 - 196 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 15.675 ms 7 - 216 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® 8 Elite Extreme Gen 6 Mobile 3.309 ms 5 - 196 MB NPU
FFNet-54S ONNX w8a8 Snapdragon® 8 Elite Gen 6 Mobile 4.783 ms 7 - 192 MB NPU
FFNet-54S QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 11.925 ms 18 - 240 MB NPU
FFNet-54S QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 16.634 ms 9 - 219 MB NPU
FFNet-54S QNN_DLC float Snapdragon® X2 Elite 14.245 ms 24 - 24 MB NPU
FFNet-54S QNN_DLC float Snapdragon® X Elite 32.917 ms 24 - 24 MB NPU
FFNet-54S QNN_DLC float Snapdragon® 8 Gen 3 Mobile 27.956 ms 16 - 286 MB NPU
FFNet-54S QNN_DLC float Snapdragon® 8 Gen 1 Mobile 46.686 ms 24 - 290 MB NPU
FFNet-54S QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 48.892 ms 24 - 53 MB NPU
FFNet-54S QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 31.524 ms 24 - 26 MB NPU
FFNet-54S QNN_DLC float Qualcomm® QCS8450 46.686 ms 24 - 290 MB NPU
FFNet-54S QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 47.754 ms 24 - 53 MB NPU
FFNet-54S QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 32.917 ms 24 - 24 MB NPU
FFNet-54S QNN_DLC float Qualcomm® Dragonwing™ Q-8750 16.634 ms 9 - 219 MB NPU
FFNet-54S QNN_DLC float Qualcomm® SA8295P 51.344 ms 24 - 216 MB NPU
FFNet-54S QNN_DLC float Snapdragon® 8 Elite Extreme Gen 6 Mobile 10.285 ms 7 - 218 MB NPU
FFNet-54S QNN_DLC float Snapdragon® 8 Elite Gen 6 Mobile 14.077 ms 24 - 212 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.611 ms 6 - 224 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 7.559 ms 6 - 214 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® X2 Elite 6.564 ms 6 - 6 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® X Elite 16.756 ms 6 - 6 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 11.044 ms 6 - 255 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 18.307 ms 6 - 260 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 49.553 ms 6 - 15 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 16.028 ms 2 - 12 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 15.899 ms 6 - 8 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® SA8775P 16.263 ms 6 - 202 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® SA8650P 16.263 ms 6 - 202 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® SA8255P 16.263 ms 6 - 202 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® QCS8450 18.307 ms 6 - 260 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 16.547 ms 8 - 17 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 16.756 ms 6 - 6 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 122.347 ms 6 - 203 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 20.037 ms 6 - 217 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 7.559 ms 6 - 214 MB NPU
FFNet-54S QNN_DLC w8a8 Qualcomm® SA8295P 21.343 ms 6 - 206 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 20.037 ms 6 - 217 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® 8 Elite Extreme Gen 6 Mobile 4.53 ms 6 - 99 MB NPU
FFNet-54S QNN_DLC w8a8 Snapdragon® 8 Elite Gen 6 Mobile 7.256 ms 6 - 184 MB NPU
FFNet-54S TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 11.955 ms 2 - 242 MB NPU
FFNet-54S TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 16.752 ms 2 - 228 MB NPU
FFNet-54S TFLITE float Snapdragon® 8 Gen 3 Mobile 28.168 ms 2 - 320 MB NPU
FFNet-54S TFLITE float Snapdragon® 8 Gen 1 Mobile 46.714 ms 3 - 316 MB NPU
FFNet-54S TFLITE float Qualcomm® Dragonwing™ IQ-8275 48.196 ms 0 - 65 MB NPU
FFNet-54S TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 31.812 ms 2 - 5 MB NPU
FFNet-54S TFLITE float Qualcomm® SA8775P 443.334 ms 2 - 27 MB GPU
FFNet-54S TFLITE float Qualcomm® SA8650P 443.334 ms 2 - 27 MB GPU
FFNet-54S TFLITE float Qualcomm® SA8255P 443.334 ms 2 - 27 MB GPU
FFNet-54S TFLITE float Qualcomm® QCS8450 46.714 ms 3 - 316 MB NPU
FFNet-54S TFLITE float Qualcomm® Dragonwing™ IQ-9075 48.047 ms 0 - 65 MB NPU
FFNet-54S TFLITE float Qualcomm® Dragonwing™ Q-8750 16.752 ms 2 - 228 MB NPU
FFNet-54S TFLITE float Qualcomm® SA7255P 145.284 ms 3 - 213 MB NPU
FFNet-54S TFLITE float Qualcomm® SA8295P 51.341 ms 3 - 214 MB NPU
FFNet-54S TFLITE float Snapdragon® 8 Elite Extreme Gen 6 Mobile 10.363 ms 2 - 234 MB NPU
FFNet-54S TFLITE float Snapdragon® 8 Elite Gen 6 Mobile 14.012 ms 2 - 212 MB NPU
FFNet-54S TFLITE w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.345 ms 1 - 218 MB NPU
FFNet-54S TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 4.365 ms 0 - 207 MB NPU
FFNet-54S TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 5.784 ms 1 - 250 MB NPU
FFNet-54S TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 10.131 ms 1 - 257 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 33.889 ms 1 - 28 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 8.548 ms 1 - 29 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.143 ms 1 - 23 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® SA8775P 243.862 ms 26 - 54 MB GPU
FFNet-54S TFLITE w8a8 Qualcomm® SA8650P 243.862 ms 26 - 54 MB GPU
FFNet-54S TFLITE w8a8 Qualcomm® SA8255P 243.862 ms 26 - 54 MB GPU
FFNet-54S TFLITE w8a8 Qualcomm® QCS8450 10.131 ms 1 - 257 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 8.45 ms 1 - 28 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 121.895 ms 3 - 199 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 12.517 ms 1 - 209 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 4.365 ms 0 - 207 MB NPU
FFNet-54S TFLITE w8a8 Qualcomm® SA7255P 591.966 ms 26 - 53 MB GPU
FFNet-54S TFLITE w8a8 Qualcomm® SA8295P 12.976 ms 0 - 198 MB NPU
FFNet-54S TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 12.517 ms 1 - 209 MB NPU
FFNet-54S TFLITE w8a8 Snapdragon® 8 Elite Extreme Gen 6 Mobile 2.445 ms 1 - 93 MB NPU
FFNet-54S TFLITE w8a8 Snapdragon® 8 Elite Gen 6 Mobile 3.4 ms 0 - 178 MB NPU

License

  • The license for the original implementation of FFNet-54S can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/FFNet-54S