Inference Providers
Active filters: INT4
agentvue/GLM-5.2-Int4-Int8Mix-FP8KV
Text Generation • 779B • Updated • 32
• 2
iSolver-AI/test123-quantized.w4a16
Image-Text-to-Text • Updated • 12
RedHatAI/phi-4-quantized.w4a16
Text Generation • 15B • Updated • 880
• 6
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text • 24B • Updated • 1.43k
• 11
RedHatAI/DeepSeek-R1-quantized.w4a16
Text Generation • 676B • Updated • 92
• 7
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text • 109B • Updated • 7.75k
• 13
RedHatAI/Qwen3-4B-quantized.w4a16
Text Generation • 4B • Updated • 5.06k
• 4
RedHatAI/Qwen3-1.7B-quantized.w4a16
Text Generation • 2B • Updated • 1k
• 3
RedHatAI/Qwen3-0.6B-quantized.w4a16
Text Generation • 0.8B • Updated • 3.84k
RedHatAI/Qwen3-32B-quantized.w4a16
Text Generation • 33B • Updated • 1.55k
• 12
RedHatAI/Qwen3-14B-quantized.w4a16
Text Generation • 15B • Updated • 97
• 2
RedHatAI/Qwen3-8B-quantized.w4a16
Text Generation • 8B • Updated • 5.01k
• 5
WaveCut/PixelWave_FLUX.1-schnell_04_SVDQuant-int4
Text-to-Image • Updated • 85
• 1
RedHatAI/Qwen3-30B-A3B-quantized.w4a16
Text Generation • 31B • Updated • 1.34k
• 7
RedHatAI/DeepSeek-R1-0528-quantized.w4a16
Text Generation • 676B • Updated • 179
• 13
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16
Image-Text-to-Text • 405B • Updated • 16.3k
• 1
RedHatAI/Kimi-K2-Instruct-quantized.w4a16
Text Generation • 1T • Updated • 128
• 12
RedHatAI/Devstral-Small-2507-quantized.w4a16
Text Generation • 4B • Updated • 44
• 2
ChibuUkachi/Qwen3-4B-Instruct-2507.w4a16
Text Generation • 4B • Updated • 11
RedHatAI/Qwen3-4B-Thinking-2507-quantized.w4a16
Text Generation • 4B • Updated • 28
RedHatAI/Qwen3-4B-Instruct-2507-quantized.w4a16
Text Generation • 4B • Updated • 1.33k
RedHatAI/Qwen3-30B-A3B-Thinking-2507-quantized.w4a16
Text Generation • 5B • Updated • 66
RedHatAI/Qwen3-30B-A3B-Instruct-2507-quantized.w4a16
Text Generation • 5B • Updated • 17.2k
• 3
RedHatAI/Qwen3-Next-80B-A3B-Instruct-quantized.w4a16
Text Generation • 12B • Updated • 467
• 4
RedHatAI/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
Text Generation • 12B • Updated • 44
EmbeddedLLM/Qwen3-VL-30B-A3B-Instruct.w4a16
Text Generation • 5B • Updated • 33
• 1
EmbeddedLLM/Qwen3-VL-30B-A3B-Thinking.w4a16
Text Generation • 5B • Updated • 27
RedHatAI/Ministral-3-14B-Instruct-2512-FP8-dynamic
Text Generation • 14B • Updated • 1.31k
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation • 12B • Updated • 262
• 1
inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16
Text Generation • 32B • Updated • 21