inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation • 12B • Updated • 1.55k
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise
3B • Updated • 17
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid
3B • Updated • 18
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid
3B • Updated • 18
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid
3B • Updated • 19
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise
1B • Updated • 36
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise
1B • Updated • 37
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid
1B • Updated • 37
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise
1B • Updated • 36
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid
1B • Updated • 37
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic
1B • Updated • 39
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise
1B • Updated • 36
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid
1B • Updated • 38
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_heuristic
1B • Updated • 35
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise
1B • Updated • 38
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_hybrid
1B • Updated • 32
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_heuristic
1B • Updated • 23
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_hybrid
1B • Updated • 26
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_heuristic
1B • Updated • 23