ggml.ai

Team

company

https://ggml.ai

ggml_org

ggml-org

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

danbev new activity 4 days ago

ggml-org/Devstral-2-123B-Instruct-2512-GGUF:What differentiates this from unsloth's quants?

danbev updated a collection 6 days ago

Devstral 2

danbev updated a model 6 days ago

ggml-org/Devstral-2-123B-Instruct-2512-GGUF

View all activity

Articles

New in llama.cpp: Model Management

14 days ago

•

ggml-org 's collections 20

Devstral 2

Collection for Devstral-Small-2-24B-Instruct-2512 models

ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF

24B • Updated 7 days ago • 518
ggml-org/Devstral-2-123B-Instruct-2512-GGUF

125B • Updated 6 days ago • 178

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli

GLM-V

Collection

4 items • Updated 8 days ago • 11
Ministral 3

Collection

6 items • Updated 9 days ago • 2
Gemma 3

Collection

10 items • Updated 9 days ago • 20
Kimi-VL

Collection

2 items • Updated 9 days ago • 1

Ministral 3

ggml-org/Ministral-3-3B-Reasoning-2512-GGUF

Image-Text-to-Text • 3B • Updated 23 days ago • 1.04k • 1
ggml-org/Ministral-3-8B-Reasoning-2512-GGUF

Image-Text-to-Text • 8B • Updated 23 days ago • 699
ggml-org/Ministral-3-14B-Reasoning-2512-GGUF

Image-Text-to-Text • 14B • Updated 23 days ago • 1.45k • 3
ggml-org/Ministral-3-3B-Instruct-2512-GGUF

Image-Text-to-Text • 3B • Updated 23 days ago • 2.01k • 2

Gemma 3-270m

Collection of models for Gemma 3-270m

ggml-org/gemma-3-270m-GGUF

0.3B • Updated Aug 14 • 1.08k • 18
ggml-org/gemma-3-270m-it-GGUF

0.3B • Updated Aug 15 • 1.28k • 19
ggml-org/gemma-3-270m-qat-GGUF

0.3B • Updated Aug 14 • 9.7k • 7
ggml-org/gemma-3-270m-it-qat-GGUF

0.3B • Updated Aug 15 • 1.79k • 11

Kimi-VL

ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF

16B • Updated Aug 20 • 2.58k • 25

VAD

Voice Activity Detection (VAD) models for whisper.cpp.

ggml-org/whisper-vad

Updated Nov 17 • 11

Qwen 2 VL and Qwen 2.5 VL

ggml-org/Qwen2.5-VL-3B-Instruct-GGUF

3B • Updated Apr 30 • 2.55k • 5
ggml-org/Qwen2.5-VL-7B-Instruct-GGUF

8B • Updated Apr 30 • 2.36k • 9
ggml-org/Qwen2.5-VL-32B-Instruct-GGUF

33B • Updated May 15 • 362 • 5
ggml-org/Qwen2-VL-2B-Instruct-GGUF

2B • Updated Apr 30 • 3.17k • 2

SmolVLM GGUF

ggml-org/SmolVLM2-2.2B-Instruct-GGUF

2B • Updated Apr 30 • 4.76k • 24
ggml-org/SmolVLM2-500M-Video-Instruct-GGUF

0.4B • Updated Apr 30 • 2.99k • 14
ggml-org/SmolVLM2-256M-Video-Instruct-GGUF

0.2B • Updated Apr 30 • 953 • 9
ggml-org/SmolVLM-Instruct-GGUF

2B • Updated Apr 30 • 557 • 8

llama.cpp presets

Models that are used for presets in llama.cpp.

ggml-org/gte-small-Q8_0-GGUF

Sentence Similarity • 33.2M • Updated Feb 6 • 52 • 2
ggml-org/bge-small-en-v1.5-Q8_0-GGUF

Feature Extraction • 33.2M • Updated Feb 6 • 220 • 3
ggml-org/e5-small-v2-Q8_0-GGUF

Sentence Similarity • 33.2M • Updated Feb 6 • 47

llama.vim

ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF

Text Generation • 0.5B • Updated Jan 31 • 2.12k • 6
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 4.41k • 12
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 2.54k • 5
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.89k • 6

NVIDIA Nemotron 3

Collection for Nemotron-Nano-3-30B-A3B models

ggml-org/Nemotron-Nano-3-30B-A3B-GGUF

32B • Updated 9 days ago • 3.94k • 8

GLM-V

ggml-org/GLM-4.6V-Flash-GGUF

9B • Updated 9 days ago • 2.19k • 10
ggml-org/GLM-4.6V-GGUF

107B • Updated 9 days ago • 1.97k • 6
ggml-org/AutoGLM-Phone-9B-GGUF

9B • Updated 8 days ago • 471 • 2
ggml-org/GLM-4.5V-GGUF

107B • Updated 9 days ago • 131 • 2

EmbeddingGemma 300M

ggml-org/embeddinggemma-300M-GGUF

0.3B • Updated Sep 4 • 1.38k • 17
ggml-org/embeddinggemma-300M-qat-q4_0-GGUF

Feature Extraction • 0.3B • Updated Sep 15 • 599 • 3
ggml-org/embeddinggemma-300m-qat-q8_0-GGUF

Feature Extraction • 0.3B • Updated Sep 15 • 866 • 5

GPT OSS

ggml-org/gpt-oss-120b-GGUF

117B • Updated Oct 30 • 153k • 48
ggml-org/gpt-oss-20b-GGUF

21B • Updated Oct 30 • 72.3k • 116

Gemma 3n

ggml-org/gemma-3n-E2B-it-GGUF

4B • Updated Aug 22 • 619 • 21
ggml-org/gemma-3n-E4B-it-GGUF

7B • Updated Jun 26 • 558 • 19

InternVL 3 and InternVL 2.5

ggml-org/InternVL3-1B-Instruct-GGUF

0.6B • Updated May 10 • 551 • 4
ggml-org/InternVL3-2B-Instruct-GGUF

2B • Updated May 10 • 567 • 5
ggml-org/InternVL3-8B-Instruct-GGUF

8B • Updated May 10 • 457 • 6
ggml-org/InternVL3-14B-Instruct-GGUF

15B • Updated May 10 • 13.4k • 4

Qwen 3

ggml-org/Qwen3-0.6B-GGUF

0.8B • Updated Sep 28 • 42.4k • 11
ggml-org/Qwen3-1.7B-GGUF

2B • Updated Apr 28 • 9.07k • 4
ggml-org/Qwen3-4B-GGUF

4B • Updated Apr 28 • 2.48k • 3
ggml-org/Qwen3-8B-GGUF

8B • Updated Apr 28 • 1.24k • 5

Gemma 3

ggml-org/gemma-3-270m-it-GGUF

0.3B • Updated Aug 15 • 1.28k • 19
ggml-org/gemma-3-1b-it-GGUF

1.0B • Updated Mar 12 • 10.8k • 21
ggml-org/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 21 • 25.6k • 45
ggml-org/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated May 21 • 9.87k • 30

GGUF LoRA adapters

Adapters extracted from fine tuned models, using mergekit-extract-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

88.1M • Updated Nov 1, 2024 • 32
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

93.6M • Updated Jan 23 • 47 • 2
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF

0.1B • Updated Jan 9 • 33 • 1
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

90.9M • Updated Jan 8 • 34 • 3

Gemma 1.1 GGUFs

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

3B • Updated Apr 5, 2024 • 53 • 1
ggml-org/gemma-1.1-7b-it-Q8_0-GGUF

9B • Updated Apr 5, 2024 • 41
ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

9B • Updated Apr 5, 2024 • 176 • 4

Devstral 2

Collection for Devstral-Small-2-24B-Instruct-2512 models

ggml-org/Devstral-Small-2-24B-Instruct-2512-GGUF

24B • Updated 7 days ago • 518
ggml-org/Devstral-2-123B-Instruct-2512-GGUF

125B • Updated 6 days ago • 178

NVIDIA Nemotron 3

Collection for Nemotron-Nano-3-30B-A3B models

ggml-org/Nemotron-Nano-3-30B-A3B-GGUF

32B • Updated 9 days ago • 3.94k • 8

Multimodal GGUFs

Vision and audio models compatible with llama-server and llama-mtmd-cli

GLM-V

Collection

4 items • Updated 8 days ago • 11
Ministral 3

Collection

6 items • Updated 9 days ago • 2
Gemma 3

Collection

10 items • Updated 9 days ago • 20
Kimi-VL

Collection

2 items • Updated 9 days ago • 1

GLM-V

ggml-org/GLM-4.6V-Flash-GGUF

9B • Updated 9 days ago • 2.19k • 10
ggml-org/GLM-4.6V-GGUF

107B • Updated 9 days ago • 1.97k • 6
ggml-org/AutoGLM-Phone-9B-GGUF

9B • Updated 8 days ago • 471 • 2
ggml-org/GLM-4.5V-GGUF

107B • Updated 9 days ago • 131 • 2

Ministral 3

ggml-org/Ministral-3-3B-Reasoning-2512-GGUF

Image-Text-to-Text • 3B • Updated 23 days ago • 1.04k • 1
ggml-org/Ministral-3-8B-Reasoning-2512-GGUF

Image-Text-to-Text • 8B • Updated 23 days ago • 699
ggml-org/Ministral-3-14B-Reasoning-2512-GGUF

Image-Text-to-Text • 14B • Updated 23 days ago • 1.45k • 3
ggml-org/Ministral-3-3B-Instruct-2512-GGUF

Image-Text-to-Text • 3B • Updated 23 days ago • 2.01k • 2

EmbeddingGemma 300M

ggml-org/embeddinggemma-300M-GGUF

0.3B • Updated Sep 4 • 1.38k • 17
ggml-org/embeddinggemma-300M-qat-q4_0-GGUF

Feature Extraction • 0.3B • Updated Sep 15 • 599 • 3
ggml-org/embeddinggemma-300m-qat-q8_0-GGUF

Feature Extraction • 0.3B • Updated Sep 15 • 866 • 5

Gemma 3-270m

Collection of models for Gemma 3-270m

ggml-org/gemma-3-270m-GGUF

0.3B • Updated Aug 14 • 1.08k • 18
ggml-org/gemma-3-270m-it-GGUF

0.3B • Updated Aug 15 • 1.28k • 19
ggml-org/gemma-3-270m-qat-GGUF

0.3B • Updated Aug 14 • 9.7k • 7
ggml-org/gemma-3-270m-it-qat-GGUF

0.3B • Updated Aug 15 • 1.79k • 11

GPT OSS

ggml-org/gpt-oss-120b-GGUF

117B • Updated Oct 30 • 153k • 48
ggml-org/gpt-oss-20b-GGUF

21B • Updated Oct 30 • 72.3k • 116

Kimi-VL

ggml-org/Kimi-VL-A3B-Thinking-2506-GGUF

16B • Updated Aug 20 • 2.58k • 25

Gemma 3n

ggml-org/gemma-3n-E2B-it-GGUF

4B • Updated Aug 22 • 619 • 21
ggml-org/gemma-3n-E4B-it-GGUF

7B • Updated Jun 26 • 558 • 19

VAD

Voice Activity Detection (VAD) models for whisper.cpp.

ggml-org/whisper-vad

Updated Nov 17 • 11

InternVL 3 and InternVL 2.5

ggml-org/InternVL3-1B-Instruct-GGUF

0.6B • Updated May 10 • 551 • 4
ggml-org/InternVL3-2B-Instruct-GGUF

2B • Updated May 10 • 567 • 5
ggml-org/InternVL3-8B-Instruct-GGUF

8B • Updated May 10 • 457 • 6
ggml-org/InternVL3-14B-Instruct-GGUF

15B • Updated May 10 • 13.4k • 4

Qwen 2 VL and Qwen 2.5 VL

ggml-org/Qwen2.5-VL-3B-Instruct-GGUF

3B • Updated Apr 30 • 2.55k • 5
ggml-org/Qwen2.5-VL-7B-Instruct-GGUF

8B • Updated Apr 30 • 2.36k • 9
ggml-org/Qwen2.5-VL-32B-Instruct-GGUF

33B • Updated May 15 • 362 • 5
ggml-org/Qwen2-VL-2B-Instruct-GGUF

2B • Updated Apr 30 • 3.17k • 2

Qwen 3

ggml-org/Qwen3-0.6B-GGUF

0.8B • Updated Sep 28 • 42.4k • 11
ggml-org/Qwen3-1.7B-GGUF

2B • Updated Apr 28 • 9.07k • 4
ggml-org/Qwen3-4B-GGUF

4B • Updated Apr 28 • 2.48k • 3
ggml-org/Qwen3-8B-GGUF

8B • Updated Apr 28 • 1.24k • 5

SmolVLM GGUF

ggml-org/SmolVLM2-2.2B-Instruct-GGUF

2B • Updated Apr 30 • 4.76k • 24
ggml-org/SmolVLM2-500M-Video-Instruct-GGUF

0.4B • Updated Apr 30 • 2.99k • 14
ggml-org/SmolVLM2-256M-Video-Instruct-GGUF

0.2B • Updated Apr 30 • 953 • 9
ggml-org/SmolVLM-Instruct-GGUF

2B • Updated Apr 30 • 557 • 8

Gemma 3

ggml-org/gemma-3-270m-it-GGUF

0.3B • Updated Aug 15 • 1.28k • 19
ggml-org/gemma-3-1b-it-GGUF

1.0B • Updated Mar 12 • 10.8k • 21
ggml-org/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 21 • 25.6k • 45
ggml-org/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated May 21 • 9.87k • 30

llama.cpp presets

Models that are used for presets in llama.cpp.

ggml-org/gte-small-Q8_0-GGUF

Sentence Similarity • 33.2M • Updated Feb 6 • 52 • 2
ggml-org/bge-small-en-v1.5-Q8_0-GGUF

Feature Extraction • 33.2M • Updated Feb 6 • 220 • 3
ggml-org/e5-small-v2-Q8_0-GGUF

Sentence Similarity • 33.2M • Updated Feb 6 • 47

GGUF LoRA adapters

Adapters extracted from fine tuned models, using mergekit-extract-lora

ggml-org/LoRA-Llama-3-Instruct-abliteration-8B-F16-GGUF

88.1M • Updated Nov 1, 2024 • 32
ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

93.6M • Updated Jan 23 • 47 • 2
ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF

0.1B • Updated Jan 9 • 33 • 1
ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

90.9M • Updated Jan 8 • 34 • 3

llama.vim

ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF

Text Generation • 0.5B • Updated Jan 31 • 2.12k • 6
ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 4.41k • 12
ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 2.54k • 5
ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.89k • 6

Gemma 1.1 GGUFs

ggml-org/gemma-1.1-2b-it-Q8_0-GGUF

3B • Updated Apr 5, 2024 • 53 • 1
ggml-org/gemma-1.1-7b-it-Q8_0-GGUF

9B • Updated Apr 5, 2024 • 41
ggml-org/gemma-1.1-7b-it-Q4_K_M-GGUF

9B • Updated Apr 5, 2024 • 176 • 4

AI & ML interests

Recent Activity

Articles

New in llama.cpp: Model Management

Team members 12

ggml-org 's collections 20