Pre-computed Q-Filters for efficient KV cache compression.
Nathan Godey
nthngdy
AI & ML interests
None yet
Recent Activity
submitted
a paper
2 days ago
Lost in Backpropagation: The LM Head is a Gradient Bottleneck updated
a model 5 days ago
nthngdy/matryoshka-baselines published
a model 5 days ago
nthngdy/matryoshka-baselines Organizations
models 60
nthngdy/matryoshka-baselines
Updated
• 20
nthngdy/matryoshka-1B
Text Generation • 1B • Updated
• 377
nthngdy/matritest_1B
Text Generation • 0.6B • Updated
• 135
nthngdy/matritest_600M
Text Generation • 0.4B • Updated
• 136
nthngdy/matritest_300M
Text Generation • 0.2B • Updated
• 155
nthngdy/matritest_van_1B
Text Generation • 1B • Updated
• 68
nthngdy/matritest_van_600M
Text Generation • 0.6B • Updated
• 68
nthngdy/matritest_van_300M
Text Generation • 0.3B • Updated
• 66
nthngdy/matritest_van_100M
Text Generation • 0.1B • Updated
• 70
nthngdy/matritest_100M
Text Generation • 0.1B • Updated
• 161
datasets 30
nthngdy/mmlu_olmo3_contamination
Viewer
• Updated
• 15.9k • 444
nthngdy/hellaswag_wikihow_olmo_contamination
Viewer
• Updated
• 1.28k • 15
nthngdy/hellaswag_activitynet
Viewer
• Updated
• 21.5k • 7
nthngdy/hellaswag_wikihow
Viewer
• Updated
• 38.4k • 8
nthngdy/mmlu_olmo_contaminated
Viewer
• Updated
• 3.33k • 821
nthngdy/mmlu_olmo_decontaminated
Viewer
• Updated
• 10.7k • 640
nthngdy/pile_small_deduped_tokenized
Viewer
• Updated
• 100k • 8
nthngdy/mmlu_olmo_contamination
Viewer
• Updated
• 15.9k • 286
nthngdy/mmlu_shuffled
Viewer
• Updated
• 31.7k • 223
nthngdy/mmlu
Viewer
• Updated
• 116k • 34