Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,704

Base only

Active filters: bitsandbytes

SanDiegoDude/Cosmos3-Super-Text2Image-nf4

Text-to-Image • 33B • Updated Jun 2 • 67 • 7

jayesh20/qlora-cyber-security-classifier

Text Generation • 8B • Updated 6 days ago • 2

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • 7B • Updated Nov 22, 2024 • 34.4k • 42

ragraph-ai/stable-cypher-instruct-3b

Text Generation • 3B • Updated Jun 12, 2025 • 752 • 34

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • 11B • Updated Dec 10, 2024 • 2.29k • 83

unsloth/SmolLM2-135M-Instruct-bnb-4bit

Text Generation • 0.1B • Updated Oct 31, 2024 • 689 • 4

unsloth/gemma-3-12b-it-bnb-4bit

Image-Text-to-Text • 13B • Updated May 12, 2025 • 8.93k • 45

unsloth/Qwen3-30B-A3B-bnb-4bit

31B • Updated May 13, 2025 • 871 • 21

wolfofbackstreet/Qwen2.5-Omni-3B-4Bit

6B • Updated May 1, 2025 • 10 • 5

unsloth/medgemma-27b-text-it-unsloth-bnb-4bit

Image-Text-to-Text • 28B • Updated May 20, 2025 • 982 • 7

nnul/sqlchat

2B • Updated Jul 13, 2025 • 1 • 1

andypyc/Qwen3-30B-A3B-bnb-8bit

31B • Updated Jul 15, 2025 • 1 • 1

PJMixers-Dev/Qwen3-30B-A3B-Instruct-2507-bnb-4bit

Text Generation • 31B • Updated Oct 12, 2025 • 48 • 1

yoshii-ai/Yoshii-7B-BR

Text Generation • 7B • Updated Dec 9, 2025 • 29 • 1

mbakgun/Qwen2.5-Coder-14B-n8n-Workflow-Generator

Text Generation • 15B • Updated Dec 28, 2025 • 1.9k • 19

seochan99/Qwen-Image-Edit-2511-bnb-nf4

Image-to-Image • 11B • Updated Dec 26, 2025 • 65 • 1

EricRollei/HunyuanImage-3.0-Instruct-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 205 • 2

jamesw767/HunyuanImage-3-Instruct-Distil-INT8

Text-to-Image • 83B • Updated Feb 21 • 34 • 1

empero-ai/openNemo-Cascade-2-30B-A3B

Text Generation • 32B • Updated Mar 24 • 394 • 10

RavichandranJ/gemma4-malware-expert-FULL

8B • Updated Apr 10 • 4 • 2

rwitz/Qwen3.6-35B-A3B-bnb-4bit

35B • Updated Apr 24 • 95 • 1

lainlives/Qwen3.6-35B-A3B-bnb-4bit

Image-Text-to-Text • 35B • Updated May 18 • 116 • 1

fe-dev-dl/Ornith-1.0-9B-Hardware-Expert-fp16

Text Generation • 9B • Updated 11 days ago • 462 • 2

GREETS11/greets-v0.1

Text Generation • 3B • Updated 4 days ago • 22 • 1

SwinliQ-AI/Qwen2.5-0.5B-Instruct-4bit

Text Generation • 0.5B • Updated about 2 hours ago • 1

dddx/mehmehmeh

Text Generation • 7B • Updated Apr 4, 2025 • 5

rosyvs/whisat

Automatic Speech Recognition • Updated Apr 29, 2025 • 2 • 3

Sakuna/LLaMaCoder

Text Generation • Updated Jan 3, 2024 • 18 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • 8B • Updated Nov 19, 2023 • 16 • 3

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 5