Inference Providers
Active filters: INT8
agentvue/GLM-5.2-Int4-Int8Mix-FP8KV
Text Generation • 779B • Updated • 34
• 2
RedHatAI/phi-4-quantized.w8a8
Text Generation • 15B • Updated • 681
• 5
RedHatAI/whisper-large-v3-quantized.w8a8
Automatic Speech Recognition • 2B • Updated • 597
• 1
RedHatAI/whisper-large-v2-quantized.w8a8
Automatic Speech Recognition • 2B • Updated • 27
RedHatAI/whisper-large-v3-turbo-quantized.w8a8
Automatic Speech Recognition • 0.9B • Updated • 562
• 5
RedHatAI/whisper-medium-quantized.w8a8
Automatic Speech Recognition • 0.8B • Updated • 26
RedHatAI/whisper-small-quantized.w8a8
Automatic Speech Recognition • 0.3B • Updated • 1.26k
RedHatAI/whisper-tiny-quantized.w8a8
Automatic Speech Recognition • 57.8M • Updated • 36
• 2
Text-to-Image • Updated • 14
imgailab/sdxl-turbo-torch-int8
Text-to-Image • Updated • 19
Text-to-Image • Updated • 10
imgailab/flux1-torch-int8
Text-to-Image • Updated • 4
RedHatAI/Devstral-Small-2507-quantized.w8a8
Text Generation • 24B • Updated • 64
• 1
RedHatAI/Qwen3-4B-Instruct-2507-quantized.w8a8
Text Generation • 4B • Updated • 700
RedHatAI/Qwen3-4B-Thinking-2507-quantized.w8a8
Text Generation • 4B • Updated • 30
RedHatAI/Qwen3-30B-A3B-Thinking-2507-quantized.w8a8
Text Generation • 31B • Updated • 41
RedHatAI/Qwen3-30B-A3B-Instruct-2507-quantized.w8a8
Text Generation • 31B • Updated • 893
amd/realesrgan-128x128-tiles-amdnpu
Image-to-Image • Updated amd/sesr-m7-512x512-tiles-amdnpu
Updated
amd/realesrgan-256x256-tiles-amdnpu
Image-to-Image • Updated amd/realesrgan-512x512-tiles-amdnpu
Image-to-Image • Updated • 2
amd/realesrgan-1024x1024-tiles-amdnpu
Image-to-Image • Updated smcleod/multitalker-parakeet-streaming-0.6b-v1-onnx-int8
RedHatAI/Qwen3-235B-A22B-Instruct-2507-quantized.w8a8
Text Generation • 235B • Updated • 89
inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8
Text Generation • 235B • Updated • 33
amd/sesr-m7-256x256-tiles-amdnpu
Updated
RedHatAI/MiniMax-M2.5-quantized.w8a8
Text Generation • 229B • Updated • 64
Text-to-Image • Updated • 14
88plug/Qwen3.6-35B-A3B-W8A16
Image-Text-to-Text • 35B • Updated • 93
• 4
88plug/Qwen3-Omni-30B-A3B-W8A16
Text Generation • 35B • Updated • 44