mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF
Text Generation • 3B • Updated • 17
Quants
Models quantized for LocalAI and llama.cpp
-
-
mudler/Minerva-3B-Instruct-v1.0-Q4_0-GGUF
Text Generation • 3B • Updated • 7 -
mudler/prem-1B-chat-Q6_K-GGUF
Text Generation • 1B • Updated • 14 -
mudler/Minerva-3B-Instruct-v1.0-Q4_K_M-GGUF
Text Generation • 3B • Updated • 13 -
mudler/prem-1B-chat-Q5_0-GGUF
Text Generation • 1B • Updated • 11 • 1 -
mudler/Minerva-1B-base-v1.0-Q5_K_M-GGUF
Text Generation • 1B • Updated • 6 -
mudler/Minerva-1B-base-v1.0-Q4_0-GGUF
Text Generation • 1B • Updated • 12 -
mudler/Minerva-350M-base-v1.0-Q8_0-GGUF
Text Generation • 0.4B • Updated • 7 -
mudler/Minerva-350M-base-v1.0-Q5_0-GGUF
Text Generation • 0.4B • Updated • 10 -
mudler/Minerva-350M-base-v1.0-Q4_0-GGUF
Text Generation • 0.4B • Updated • 9 -
mudler/Llama-3-8b-ita-ties2-Q4_K_M-GGUF
8B • Updated • 40 • 1