Distilling 100B+ Models 40x Faster with TRL
📝
47
TRL distillation for 100B+ teachers, 40x faster
Ram Ananth PRO
RamAnanth1
AI & ML interests
Reinforcement Learning
Recent Activity
liked a Space 1 day ago
HuggingFaceTB/trl-distillation-trainer updated a dataset 29 days ago
RamAnanth1/Nemotron3-Super-Reasoning-2000x published a dataset 29 days ago
RamAnanth1/Nemotron3-Super-Reasoning-2000xOrganizations
liked a
Space 1 day ago
updated a
dataset 29 days ago
published a
dataset 29 days ago
updated a
Space about 2 months ago
updated a
model about 2 months ago
upvoted an article about 2 months ago
Article
GGML and llama.cpp join HF to ensure the long-term progress of Local AI
- +4
•
501
liked a
Space about 2 months ago
updated a
Space about 2 months ago
published a
model about 2 months ago
reactedto sergiopaniego's post with 🔥 about 2 months ago
Post
1531
Tiny Aya 🌿 just dropped from @CohereLabs , a really powerful multilingual small model!
To celebrate, we cooked up fresh resources to train it for tool calling 🔧
> Free Google Colab guide: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_tool_calling.ipynb
> Standalone training script: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_tiny_aya_tool_calling.py
To celebrate, we cooked up fresh resources to train it for tool calling 🔧
> Free Google Colab guide: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_tool_calling.ipynb
> Standalone training script: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_tiny_aya_tool_calling.py
upvoted an article about 2 months ago
Article
Train AI models with Unsloth and Hugging Face Jobs for FREE
- +4
•
96
updated a
model 2 months ago
published a
model 2 months ago
updated a
dataset 2 months ago
published a
dataset 2 months ago
updated 2
Spaces 4 months ago
liked a
dataset 4 months ago
updated a
Space 6 months ago
upvoted an article 6 months ago
Article
Sentence Transformers is joining Hugging Face!
•
88