Train From Scratch avec Flash Attention

Précision Supporté = FP32 , FP16 , BF16

Attention Supporté : Torch-Attention , Sage-Attention , Flash-Attention-2 , Flash-Attention-3

Bon train ! Que la loss tombe bien !

README.md en cours d'ecriture ...

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support