Mistral Small 4
Collection
A state-of-the-art model, open-weight, with a granular Mixture-of-Experts architecture that fuses instruct, reasoning and agentic skills. ā¢ 3 items ā¢ Updated ā¢ 65
Fiki something
Fik
AI & ML interests
None yet
Recent Activity
upvoted a collection 26 days ago
Mistral Small 4 liked a Space about 1 year ago
fastrtc/talk-to-gemini upvoted a collection about 1 year ago
FastRTC Custom UIsOrganizations
upvoted a collection 26 days ago
liked a
Space about 1 year ago
upvoted a collection about 1 year ago
updated a
collection about 1 year ago
liked a
Space about 1 year ago
liked a
model over 1 year ago
upvoted 3
collections over 1 year ago
reactedto singhsidhukuldeep's post with ššā¤ļøš over 1 year ago
Post
2205
It's not every day you see a research paper named "Alice's Adventures in a Differentiable Wonderland," and when you open it, it's a 281-page book!
I haven't completed it yet, but this amazing work, written by Simone Scardapane, is a fascinating introduction to deep neural networks and differentiable programming.
Some key technical highlights:
ā¢ Covers core concepts like automatic differentiation, stochastic optimization, and activation functions in depth
ā¢ Explains modern architectures like convolutional networks, transformers, and graph neural networks
ā¢ Provides mathematical foundations including linear algebra, gradients, and probability theory
ā¢ Discusses implementation details in PyTorch and JAX
ā¢ Explores advanced topics like Bayesian neural networks and neural scaling laws
The book takes a unique approach, framing neural networks as compositions of differentiable primitives rather than biological analogs. It provides both theoretical insights and practical coding examples.
I especially enjoyed the sections on:
ā¢ Vector-Jacobian products and reverse-mode autodiff
ā¢ Stochastic gradient descent and mini-batch optimization
ā¢ ReLU, GELU, and other modern activation functions
ā¢ Universal approximation capabilities of MLPs
Whether you're new to deep learning or an experienced practitioner, this book offers valuable insights into the fundamentals and latest developments. Highly recommended for anyone working with neural networks!
I haven't completed it yet, but this amazing work, written by Simone Scardapane, is a fascinating introduction to deep neural networks and differentiable programming.
Some key technical highlights:
ā¢ Covers core concepts like automatic differentiation, stochastic optimization, and activation functions in depth
ā¢ Explains modern architectures like convolutional networks, transformers, and graph neural networks
ā¢ Provides mathematical foundations including linear algebra, gradients, and probability theory
ā¢ Discusses implementation details in PyTorch and JAX
ā¢ Explores advanced topics like Bayesian neural networks and neural scaling laws
The book takes a unique approach, framing neural networks as compositions of differentiable primitives rather than biological analogs. It provides both theoretical insights and practical coding examples.
I especially enjoyed the sections on:
ā¢ Vector-Jacobian products and reverse-mode autodiff
ā¢ Stochastic gradient descent and mini-batch optimization
ā¢ ReLU, GELU, and other modern activation functions
ā¢ Universal approximation capabilities of MLPs
Whether you're new to deep learning or an experienced practitioner, this book offers valuable insights into the fundamentals and latest developments. Highly recommended for anyone working with neural networks!
updated a
Space over 1 year ago
liked a
Space over 1 year ago
liked a
Space almost 2 years ago
liked a
model almost 2 years ago
liked a
Space almost 2 years ago
upvoted a collection almost 2 years ago