Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

102

Full-text search

Active filters: llm-compressor

nm-testing/granite-4.0-h-small-FP8-block

Text Generation • 32B • Updated 27 days ago • 62

tcclaviger/Qwen3-42B-A3B-2507-Thinking-TOTAL-RECALL-v2-Medium-MASTER-CODER

Text Generation • 6B • Updated Oct 29 • 10

RedHatAI/granite-4.0-h-small-FP8-block

Text Generation • 32B • Updated 11 days ago • 101

nm-testing/granite-4.0-h-small-FP8-dynamic

Text Generation • 32B • Updated 11 days ago • 61

starbix/Apertus-8B-Instruct-2509-FP8_dynamic

Text Generation • 8B • Updated 25 days ago • 52

coughmedicine/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-W4A16

Updated 5 days ago • 19

RedHatAI/Qwen3-VL-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated 4 days ago • 10

RedHatAI/Qwen3-VL-32B-Instruct-FP8-block

Text Generation • 33B • Updated 4 days ago • 8

RedHatAI/Qwen3-VL-32B-Instruct-NVFP4

Text Generation • 20B • Updated 4 days ago • 151

RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-dynamic

Text Generation • 80B • Updated 3 days ago • 24

RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-block

Text Generation • 80B • Updated 3 days ago • 17

coughmedicine/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-nvfp4

Updated 2 days ago • 66