Running on CPU Upgrade 233 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens 📝 233 Explore synthetic data experiments on a virtual bookshelf
Running 105 Unlocking On-Policy Distillation for Any Model Family 📝 105 Visualize on-policy distillation for any model family
Running on CPU Upgrade Featured 3.18k The Smol Training Playbook 📚 3.18k The secrets to building world-class LLMs
distilbert/distilbert-base-cased-distilled-squad Question Answering • 65.2M • Updated May 6, 2024 • 214k • • 267
Running 3.84k The Ultra-Scale Playbook 🌌 3.84k The ultimate guide to training LLM on large GPU Clusters