Pretraining Context Compressor for Large Language Models with Embedding-Based Memory
YuHong Dai
BroAlanTaps
AI & ML interests
CV(2D-Object Detection), NLP(Infer Accelerate)
Recent Activity
authored
a paper
about 5 hours ago
Proact-VL: A Proactive VideoLLM for Real-Time AI Companions upvoted a paper about 6 hours ago
Proact-VL: A Proactive VideoLLM for Real-Time AI Companions upvoted a collection 9 days ago
Qwen3.5 Organizations
models 123
BroAlanTaps/wikipedia-visual-en-qwen2.5-2b-instruct-lora-sft-wikipedia-samples
Image-Text-to-Text • 2B • Updated
BroAlanTaps/Stage2-PCC-Large-16x
Updated
BroAlanTaps/Stage2-PCC-Large-128x
Updated
BroAlanTaps/Stage2-PCC-Large-4x
Updated
BroAlanTaps/PCC-Large-Encoder-Llama3-8B-Instruct
8B • Updated
BroAlanTaps/Stage1-PCC-Large-128x
Updated
BroAlanTaps/Stage2-PCC-Lite-256x
0.8B • Updated
BroAlanTaps/Stage2-PCC-Lite-128x
0.8B • Updated
• 1
BroAlanTaps/Stage2-PCC-Lite-64x
0.8B • Updated
BroAlanTaps/Stage2-PCC-Lite-16x
0.8B • Updated
• 1
datasets 7
BroAlanTaps/Warmup-GPT2-Large-Llama3-8B-Redpajama
Viewer
• Updated
• 1.55M • 16 • 1
BroAlanTaps/pretrain-corpus-test
Viewer
• Updated
• 576 • 83
BroAlanTaps/GPT2-Large-Llama3-8B-fineweb-256-5Btokens
Viewer
• Updated
• 19.2M • 22 • 1
BroAlanTaps/efficiency_samples_8k
Viewer
• Updated
• 1k • 5
BroAlanTaps/Stage2-PCC-Large-SFT-Squad
Viewer
• Updated
• 92.7k • 16
BroAlanTaps/Stage2-PCC-SFT-HotpotQA
Viewer
• Updated
• 90.4k • 110
BroAlanTaps/Stage2-PCC-Lite-SFT-Squad
Viewer
• Updated
• 92.7k • 166