Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
SmallThinker-4BA0.6B-Instruct
like
0
Text Generation
GGUF
English
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
SmallThinker-4BA0.6B-Instruct
63.1 GB
1 contributor
History:
1 commit
Mungert
Super-squash history to reclaim storage
d3fefc1
verified
3 months ago
.gitattributes
Safe
4.09 kB
Super-squash history to reclaim storage
3 months ago
README.md
Safe
5.7 kB
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-bf16.gguf
8.55 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-bf16_q8_0.gguf
6.04 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-f16_q8_0.gguf
6.04 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-imatrix.gguf
Safe
16.8 MB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-iq2_s.gguf
1.69 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-iq2_xs.gguf
1.69 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-iq2_xxs.gguf
1.53 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q2_k_s.gguf
1.81 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q3_k_m.gguf
2.37 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q3_k_s.gguf
2.3 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q4_0.gguf
2.41 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q4_1.gguf
2.68 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q4_k_m.gguf
2.77 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q4_k_s.gguf
2.65 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q5_0.gguf
2.95 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q5_1.gguf
3.21 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q5_k_m.gguf
3.17 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q5_k_s.gguf
3.13 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q6_k_m.gguf
3.51 GB
xet
Super-squash history to reclaim storage
3 months ago
SmallThinker-4BA0.6B-Instruct-q8_0.gguf
4.55 GB
xet
Super-squash history to reclaim storage
3 months ago
