view article Article Making Knowledge Distillation Cheap Enough to Run at Scale MultiverseComputingCAI • 9 days ago • 32
Running Featured 92 Distilling 100B+ Models 40x Faster with TRL 📝 92 TRL distillation for 100B+ teachers, 40x faster