Unsloth 4-bit Dynamic Quants
Collection
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
•
28 items
•
Updated
•
93