What differentiates this from unsloth's quants?
#1
by
BingoBird
- opened
What differentiates this from unsloth's quants?
I don't know exactly how Unsloth quantizes their model but this model was quantized just using llama-quantize.
Having models under the ggml organization on Hugging Face allows for a little more control of the models availability which is also a reason we quantize and publish them.
Thanks for the response and thanks for your contributions :)