-
-
-
-
-
-
Inference Providers
Active filters:
4-bit
huihui-ai/Huihui-GLM-4.6-abliterated-mlx-4bit
Text Generation
•
353B
•
Updated
•
970
•
16
Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32
Text-to-Image
•
Updated
•
22.1k
•
45
mlx-community/GLM-4.6V-Flash-4bit
Image-Text-to-Text
•
Updated
•
955
•
5
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
31B
•
Updated
•
522k
•
42
huihui-ai/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-mlx-4bit
Text Generation
•
80B
•
Updated
•
1.84k
•
3
mlx-community/GLM-4.6V-4bit
Image-Text-to-Text
•
Updated
•
622
•
3
PLOI-Labs/lh-degen-001
Updated
•
20
•
3
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
33B
•
Updated
•
56.9k
•
592
Qwen/Qwen2.5-VL-7B-Instruct-AWQ
Image-Text-to-Text
•
8B
•
Updated
•
188k
•
95
gaunernst/gemma-3-12b-it-int4-awq
Image-Text-to-Text
•
12B
•
Updated
•
3.99k
•
22
IDEA-Research/Rex-Omni-AWQ
4B
•
Updated
•
1.94k
•
3
nightmedia/gpt-oss-120b-heretic-v2-mxfp4-q8-hi-mlx
Text Generation
•
117B
•
Updated
•
934
•
6
Disty0/FLUX.2-dev-SDNQ-uint4-svd-r32
Updated
•
639
•
11
avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16
Text Generation
•
271B
•
Updated
•
249
•
2
QuantTrio/DeepSeek-V3.2-AWQ
Text Generation
•
685B
•
Updated
•
1.91k
•
4
MaziyarPanahi/Hermes-4.3-36B-GGUF
Text Generation
•
36B
•
Updated
•
20.1k
•
2
steampunque/Ministral-3-3B-Instruct-2512-Hybrid-GGUF
3B
•
Updated
•
146
•
2
MaziyarPanahi/GLM-4.6V-Flash-GGUF
Text Generation
•
9B
•
Updated
•
15.5k
•
2
nn-tech/MetalGPT-1-AWQ
Text Generation
•
33B
•
Updated
•
33
•
2
TheBloke/Falcon-7B-Instruct-GPTQ
Text Generation
•
7B
•
Updated
•
139
•
68
TheBloke/Llama-2-7B-Chat-GPTQ
Text Generation
•
7B
•
Updated
•
10.5k
•
267
TheBloke/13B-BlueMethod-GPTQ
Text Generation
•
13B
•
Updated
•
141
•
6
TheBloke/Octocoder-GPTQ
Text Generation
•
16B
•
Updated
•
27
•
8
jxy/Tongyi-Finance-14B-Chat-Int4
Text Generation
•
Updated
•
15
•
2
TheBloke/saiga_mistral_7b-AWQ
Text Generation
•
7B
•
Updated
•
150
•
4
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
47B
•
Updated
•
354k
•
140
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
7B
•
Updated
•
27.8k
•
55
unsloth/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation
•
7B
•
Updated
•
10.8k
•
34
unsloth/mistral-7b-instruct-v0.1-bnb-4bit
Text Generation
•
7B
•
Updated
•
543
•
7
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
•
8B
•
Updated
•
293k
•
89