Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12,427

Base only

Active filters: quantized

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Image-Text-to-Text • 9B • Updated 9 days ago • 2.13M • 2.44k

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

Text Generation • 1B • Updated 10 days ago • 121k • 158

empero-ai/Qwythos-9B-v2-GGUF

Image-Text-to-Text • 9B • Updated 12 days ago • 264k • 209

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF

Text Generation • 1B • Updated 10 days ago • 241k • 297

InternScience/Agents-A1-4B-Q8_0-GGUF

Text Generation • 4B • Updated 9 days ago • 9.72k • 33

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated 22 days ago • 74.7k • 101

m15dg/local-ai-toolkit

Text Generation • 35B • Updated 5 days ago • 23k • 24

nvidia/Qwen3.6-27B-NVFP4

Text Generation • 18B • Updated 23 days ago • 1.69M • 388

InternScience/Agents-A1-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated 9 days ago • 11.1k • 23

badtheorylabs/BTL-3-Compact

Text Generation • 8B • Updated about 14 hours ago • 251 • 19

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated about 15 hours ago • 8 • 30

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated Jun 12 • 9.28M • 490

InternScience/Agents-A1-Q4_K_M-GGUF

Text Generation • 35B • Updated 9 days ago • 58k • 123

antirez/deepseek-v4-gguf

Text Generation • 20B • Updated 7 days ago • 1.68M • 338

ewinregirgojr/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated about 6 hours ago • 14.6k • 66

Abiray/Laguna-S-2.1-IQ4_XS-Q4_K_M-GGUF

Text Generation • 84B • Updated 1 day ago • 314 • 11

vcruz305/Laguna-S-2.1-GGUF

Text Generation • 118B • Updated 1 day ago • 1.11k • 9

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated 27 days ago • 1.56M • 277

supermind/int8_convrot_models

Updated 13 days ago • 14

Abiray/Nanbeige4.2-3B-GGUF

Text Generation • 4B • Updated 1 day ago • 1.26k • 9

AtomicChat/Laguna-S-2.1-GGUF

Text Generation • 118B • Updated about 23 hours ago • 1.63k • 6

FINAL-Bench/POCKET-KR-GGUF

Text Generation • 23B • Updated about 15 hours ago • 6 • 23

FINAL-Bench/POCKET-EN-GGUF

Text Generation • 23B • Updated about 15 hours ago • 9 • 23

FINAL-Bench/POCKET-KR-MLX

Text Generation • 15B • Updated about 15 hours ago • 7 • 23

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 18.2k • 61

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 1.3M • 121

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 568k • 105

tencent/Hy3-FP8

Text Generation • 299B • Updated 4 days ago • 18.3k • 64

migtissera/Tess-4-27B-GGUF

Image-Text-to-Text • 27B • Updated 14 days ago • 25.4k • 29

audio-cpp/audio.cpp-gguf

Text-to-Speech • Updated about 2 hours ago • 9.06k • 6