Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning
Paper ā¢ 2605.14386 ā¢ Published ā¢ 36
Jonatan Borkowski
j14i
AI & ML interests
None yet
Recent Activity
upvoted a paper about 3 hours ago
Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning reacted to SeaWolf-AI's post with š„ about 3 hours ago
š§¬ Darwin Family: Zero Gradient Steps, GPQA Diamond 88.89%
How far can we push LLM reasoning *without* training?
Our team at VIDRAFT submitted this paper to Daily Papers yesterday, and it's
currently #3. Huge thanks to everyone who upvoted ā sharing the core ideas below.
š Paper: https://huggingface.co/papers/2605.14386
š arXiv: https://arxiv.org/abs/2605.14386
š Model: https://huggingface.co/FINAL-Bench/Darwin-28B-Opus
---
TL;DR
Darwin Family is a training-free evolutionary merging framework.
By recombining the weight spaces of existing LLM checkpoints ā with zero
gradient-based training ā it reaches frontier-level reasoning.
- š Darwin-28B-Opus: GPQA Diamond 88.89%
- šø Zero gradient steps ā not a single B200 or H200 hour needed
- š§¬ Consistent gains across 4B ā 35B scale
- š Cross-architecture breeding between Transformer and Mamba families
- š Stable recursive multi-generation evolution
#Three Core Mechanisms
ā 14-dim Adaptive Merge Genome ā fine-grained recombination at both
component level (Attention / FFN / MLP / LayerNorm / Embedding) and block
level, expanding the prior evolutionary-merge search space.
ā” MRI-Trust Fusion ā we diagnose each layer's reasoning contribution
via an **MRI (Model Reasoning Importance)** signal and fuse it with
evolutionary search through a **learnable trust parameter**. Trust the
diagnostic too much and search collapses; ignore it and search becomes
inefficient ā Darwin learns the balance from data.
ā¢ Architecture Mapper ā weight-space breeding across heterogeneous
families. Attention Ć SSM crossover actually works.
Why It Matters
> Diagnose latent capabilities already encoded in open checkpoints,
> and recombine them ā no gradients required.
Replies and critiques welcome šOrganizations
upvoted a paper about 3 hours ago
reacted to SeaWolf-AI's post with š„ about 3 hours ago
Post
692
š§¬ Darwin Family: Zero Gradient Steps, GPQA Diamond 88.89%
How far can we push LLM reasoning *without* training?
Our team at VIDRAFT submitted this paper to Daily Papers yesterday, and it's
currently #3. Huge thanks to everyone who upvoted ā sharing the core ideas below.
š Paper: Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning (2605.14386)
š arXiv: https://arxiv.org/abs/2605.14386
š Model: FINAL-Bench/Darwin-28B-Opus
---
TL;DR
Darwin Family is a training-free evolutionary merging framework.
By recombining the weight spaces of existing LLM checkpoints ā with zero
gradient-based training ā it reaches frontier-level reasoning.
- š Darwin-28B-Opus: GPQA Diamond 88.89%
- šø Zero gradient steps ā not a single B200 or H200 hour needed
- š§¬ Consistent gains across 4B ā 35B scale
- š Cross-architecture breeding between Transformer and Mamba families
- š Stable recursive multi-generation evolution
#Three Core Mechanisms
ā 14-dim Adaptive Merge Genome ā fine-grained recombination at both
component level (Attention / FFN / MLP / LayerNorm / Embedding) and block
level, expanding the prior evolutionary-merge search space.
ā” MRI-Trust Fusion ā we diagnose each layer's reasoning contribution
via an **MRI (Model Reasoning Importance)** signal and fuse it with
evolutionary search through a **learnable trust parameter**. Trust the
diagnostic too much and search collapses; ignore it and search becomes
inefficient ā Darwin learns the balance from data.
ā¢ Architecture Mapper ā weight-space breeding across heterogeneous
families. Attention Ć SSM crossover actually works.
Why It Matters
> Diagnose latent capabilities already encoded in open checkpoints,
> and recombine them ā no gradients required.
Replies and critiques welcome š
How far can we push LLM reasoning *without* training?
Our team at VIDRAFT submitted this paper to Daily Papers yesterday, and it's
currently #3. Huge thanks to everyone who upvoted ā sharing the core ideas below.
š Paper: Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning (2605.14386)
š arXiv: https://arxiv.org/abs/2605.14386
š Model: FINAL-Bench/Darwin-28B-Opus
---
TL;DR
Darwin Family is a training-free evolutionary merging framework.
By recombining the weight spaces of existing LLM checkpoints ā with zero
gradient-based training ā it reaches frontier-level reasoning.
- š Darwin-28B-Opus: GPQA Diamond 88.89%
- šø Zero gradient steps ā not a single B200 or H200 hour needed
- š§¬ Consistent gains across 4B ā 35B scale
- š Cross-architecture breeding between Transformer and Mamba families
- š Stable recursive multi-generation evolution
#Three Core Mechanisms
ā 14-dim Adaptive Merge Genome ā fine-grained recombination at both
component level (Attention / FFN / MLP / LayerNorm / Embedding) and block
level, expanding the prior evolutionary-merge search space.
ā” MRI-Trust Fusion ā we diagnose each layer's reasoning contribution
via an **MRI (Model Reasoning Importance)** signal and fuse it with
evolutionary search through a **learnable trust parameter**. Trust the
diagnostic too much and search collapses; ignore it and search becomes
inefficient ā Darwin learns the balance from data.
ā¢ Architecture Mapper ā weight-space breeding across heterogeneous
families. Attention Ć SSM crossover actually works.
Why It Matters
> Diagnose latent capabilities already encoded in open checkpoints,
> and recombine them ā no gradients required.
Replies and critiques welcome š
reacted to spillai's post with š„ 2 days ago
Post
8620
mm-ctx ā fast, multimodal context for agents.
LLM-based agents handle text incredibly well, but images, videos, or PDFs with visual content are hard to interpret. mm-ctx gives your CLI agent multi-modal skills.
Try it interactively in Spaces: vlm-run/mm-ctx
Readme: https://vlm-run.github.io/mm/
PyPI: https://pypi.org/project/mm-ctx
SKILL.md: https://github.com/vlm-run/skills/blob/main/skills/mm-cli-skill/SKILL.md
mm-ctx is meant to feel familiar: the UNIX tools we already love (find/cat/grep/wc), rebuilt for file types LLMs can't read natively and designed to work with agents via the CLI.
- mm grep "invoice #1234" ~/Downloads searches across PDFs and returns line-numbered matches
- mm cat <document>.pdf returns a metadata description of the file
- mm cat <photo>.jpg returns a caption of the photo
- mm cat <video>.mp4 returns a caption of the video
A few things we obsessed over:
ā” Speed: Rust core for the hot paths
š Local-first, BYO model: Uses any OpenAI-compatible endpoint: Ollama, vLLM/SGLang, LMStudio with any multimodal LLM (Gemma4, Qwen3.5, GLM-4.6V).
š Composable: stdin + structured outputs
š¤ Drops into any agent via mm-cli-skills: Claude Code, Codex, Gemini CLI, OpenClaw.
Weād love to hear your feedback! Especially on the CLI and what file types and workflows you would like to see next.
LLM-based agents handle text incredibly well, but images, videos, or PDFs with visual content are hard to interpret. mm-ctx gives your CLI agent multi-modal skills.
Try it interactively in Spaces: vlm-run/mm-ctx
Readme: https://vlm-run.github.io/mm/
PyPI: https://pypi.org/project/mm-ctx
SKILL.md: https://github.com/vlm-run/skills/blob/main/skills/mm-cli-skill/SKILL.md
mm-ctx is meant to feel familiar: the UNIX tools we already love (find/cat/grep/wc), rebuilt for file types LLMs can't read natively and designed to work with agents via the CLI.
- mm grep "invoice #1234" ~/Downloads searches across PDFs and returns line-numbered matches
- mm cat <document>.pdf returns a metadata description of the file
- mm cat <photo>.jpg returns a caption of the photo
- mm cat <video>.mp4 returns a caption of the video
A few things we obsessed over:
ā” Speed: Rust core for the hot paths
š Local-first, BYO model: Uses any OpenAI-compatible endpoint: Ollama, vLLM/SGLang, LMStudio with any multimodal LLM (Gemma4, Qwen3.5, GLM-4.6V).
š Composable: stdin + structured outputs
š¤ Drops into any agent via mm-cli-skills: Claude Code, Codex, Gemini CLI, OpenClaw.
Weād love to hear your feedback! Especially on the CLI and what file types and workflows you would like to see next.
- 2 replies
updated a
model 2 days ago
published a
model 4 days ago
updated a
dataset 4 days ago
published a
dataset 4 days ago
updated a
model 4 days ago
published a
model 4 days ago
updated a
model 4 days ago
published a
model 5 days ago
updated a
dataset 5 days ago
published a
dataset 5 days ago
updated a
dataset 6 days ago
published a
dataset 6 days ago
updated a
model 6 days ago
published a
model 7 days ago
liked a
Space 10 days ago
liked a
model 24 days ago
liked a
model 27 days ago
