mgoin/Qwen3-0.6B-MXFP8
0.6B • Updated • 2
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
updated a model 18 days ago
RedHatAI/gemma-4-26B-A4B-it-NVFP4 upvoted a paper 2 months ago
Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation new activity 2 months ago
GadflyII/GLM-4.7-Flash-MXFP4:Update MXFP4 format to compressed-tensorsOrganizations
mgoin/GLM-4.6-FP8-BLOCK
Text Generation • 357B • Updated • 70
mgoin/Qwen3-0.6B-NVFP4
0.6B • Updated • 79
mgoin/mlperf-inference-llama3.1-8b-data
Updated
mgoin/Llama-3.1-8B-Instruct-FP8-BLOCK
8B • Updated • 3
mgoin/SEMIKONG-70B-W4A16-G128
11B • Updated • 2
mgoin/llama-4-tiny-random
Text Generation • 6.69M • Updated • 5
mgoin/Qwen1.5-14B-Chat-GPTQ
Text Generation • Updated • 3
mgoin/pixtral-12b
Image-Text-to-Text • 13B • Updated • 370 • 1
mgoin/Llama-3.2-1B-Instruct-FP8-ATTN
1B • Updated • 1
mgoin/Llama-3.2-1B-Instruct-FP8-dynamic-ATTN
1B • Updated • 1
mgoin/Pixtral-Large-Instruct-2411
Updated
mgoin/Qwen2.5-Coder-32B-Instruct-fp8
Updated
mgoin/nemotron-3-8b-chat-4k-sft-hf
Text Generation • 9B • Updated • 8
mgoin/llava-onevision-qwen2-7b-ov-hf-bnb-full-4bit
Image-Text-to-Text • 8B • Updated • 10
mgoin/MiniCPM-Llama3-V-2_5-int4
Visual Question Answering • 9B • Updated • 2
mgoin/DeepSeek-Coder-V2-Lite-Instruct-FP8
16B • Updated • 2
mgoin/Mixtral-8x7B-Instruct-v0.1-FP8
47B • Updated • 1
mgoin/Nemotron-nemo-checkpoints
Updated
mgoin/Minitron-4B-Base-FP8
Text Generation • 4B • Updated • 7 • 3
mgoin/Nemotron-4-340B-Base-hf
Text Generation • 341B • Updated • 5 • 1
mgoin/Nemotron-4-340B-Instruct-hf-FP8
Text Generation • 341B • Updated • 68 • 3
mgoin/Nemotron-4-340B-Base-hf-FP8
Text Generation • 341B • Updated • 36 • 2
mgoin/Nemotron-4-340B-Instruct-hf
Text Generation • 341B • Updated • 16 • 4
mgoin/SparseLLama-2-7b-ultrachat_200k-pruned_50.2of4-compressed-tensors
4B • Updated • 1
mgoin/Minitron-8B-Base-FP8
Text Generation • 8B • Updated • 4 • 3
mgoin/Nemotron-4-340B-Instruct-FP8-Dynamic
Text Generation • 341B • Updated • 12
mgoin/Nemotron-4-340B-Instruct-vllm
Text Generation • 341B • Updated • 8
mgoin/Mistral-Nemo-Instruct-2407-FP8-KV
Text Generation • 12B • Updated • 3
mgoin/Mistral-Nemo-Instruct-2407-FP8-Dynamic
Text Generation • 12B • Updated • 150