My models: daily driver rotation
Collection
A rotating list of models I created and currently use as daily drivers. From my many models, these are the ones I’m actively using. • 5 items • Updated • 9
Digital Spellcaster
DigitalSpellcaster
AI & ML interests
Primary interest is models for my Pixel 10 Pro
Recent Activity
upvoted a collection 1 day ago
My models: daily driver rotation liked a model 2 days ago
Vortex5/Moonlit-Mirage-12B liked a model 5 days ago
Vortex5/Celestial-Queen-12BOrganizations
None yet
upvoted a collection 1 day ago
liked a
model 2 days ago
liked a
model 5 days ago
liked a
model 12 days ago
I would be interested in some more NVF4P Quants
4
#2 opened about 1 month ago
by DigitalSpellcaster
upvoted a collection about 1 month ago
liked 2
models about 1 month ago
upvoted 2
collections about 1 month ago
liked a
model 2 months ago
upvoted a collection 3 months ago
reacted to IlyasMoutawwakil's post with 🔥 3 months ago
Post
2454
After 2 months of refinement, I'm happy to announce that a lot of Transformers' modeling code is now significantly more torch-compile & export-friendly 🔥
Why it had to be done 👇
PyTorch's Dynamo compiler is increasingly becoming the default interoperability layer for ML systems. Anything that relies on torch.export or torch.compile, from model optimization to cross-framework integrations, benefits directly when models can be captured as a single dynamo-traced graph !
Transformers models are now easier to:
⚙️ Compile end-to-end with torch.compile backends
📦 Export reliably via torch.export and torch.onnx.export
🚀 Deploy to ONNX / ONNX Runtime, Intel Corporation's OpenVINO, NVIDIA AutoDeploy (TRT-LLM), AMD's Quark, Meta's Executorch and more hardware-specific runtimes.
This work aims at unblocking entire TorchDynamo-based toolchains that rely on exporting Transformers across runtimes and accelerators.
We are doubling down on Transformers commitment to be a first-class citizen of the PyTorch ecosystem, more exportable, more optimizable, and easier to deploy everywhere.
There are definitely some edge-cases that we still haven't addressed so don't hesitate to try compiling / exporting your favorite transformers and to open issues / PRs.
PR in the comments ! More updates coming coming soon !
Why it had to be done 👇
PyTorch's Dynamo compiler is increasingly becoming the default interoperability layer for ML systems. Anything that relies on torch.export or torch.compile, from model optimization to cross-framework integrations, benefits directly when models can be captured as a single dynamo-traced graph !
Transformers models are now easier to:
⚙️ Compile end-to-end with torch.compile backends
📦 Export reliably via torch.export and torch.onnx.export
🚀 Deploy to ONNX / ONNX Runtime, Intel Corporation's OpenVINO, NVIDIA AutoDeploy (TRT-LLM), AMD's Quark, Meta's Executorch and more hardware-specific runtimes.
This work aims at unblocking entire TorchDynamo-based toolchains that rely on exporting Transformers across runtimes and accelerators.
We are doubling down on Transformers commitment to be a first-class citizen of the PyTorch ecosystem, more exportable, more optimizable, and easier to deploy everywhere.
There are definitely some edge-cases that we still haven't addressed so don't hesitate to try compiling / exporting your favorite transformers and to open issues / PRs.
PR in the comments ! More updates coming coming soon !
- 1 reply