Spaces:

---

Glint-Research

/

Tiny-ML-Leaderboard

like 37

Running

TinyMoE-100m-2x8-retrained is trained on a mix of Cosmopedia-v2 and
FineWeb-Edu-dedup (60/40) from the smollm-corpus. Also re-evaluated
TinyMoE-100m-2x8 with corrected metrics.

For context, I initially misread the leaderboard's terms and used plain
acc and bits-per-byte. Both entries now correctly use acc_norm for
ARC-Easy and byte perplexity for WikiText-2, so the original model's
scores are lower than what I first reported elsewhere.

Both models have been evaluated using lm-eval.

Hope this is fine — let me know if anything else needs adjusting. I do not want to fraudate the result of the model.