wenhua cheng

wenhuach's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in TelperionAI/Qwen3.8-27B-NVFP4-AWQ-AutoRound-allfp4 8 days ago

AutoRound has recently supported AWQ+SignRound

👍 1

#1 opened 8 days ago by

wenhuach

New activity in Intel/Qwen3.6-35B-A3B-int2-mixed-CT-AutoRound 14 days ago

Need help

4

#1 opened 19 days ago by

tooltd

New activity in Intel/Qwen3.6-35B-A3B-int2-mixed-CT-AutoRound 16 days ago

Convert to OpenVINO

1

#2 opened 18 days ago by

savvadesogle

New activity in Intel/Qwen3.6-27B-int4-AutoRound 23 days ago

spills reasoning into code

2

#3 opened 24 days ago by

MilestoneAI

New activity in Intel/gemma-4-31B-it-int4-AutoRound 3 months ago

This quant is the best. Please conver it to GGUF

5

#7 opened 3 months ago by

alexcardo

New activity in Intel/gemma-4-12B-it-int4-AutoRound 3 months ago

torch RuntimeError: Shape mismatch: a.size(1) = 4096, size_k = 8192

2

#1 opened 3 months ago by

saadsafi

New activity in Intel/gemma-4-31B-it-int4-AutoRound 3 months ago

INT8 version for TP=2 / dual Ampere GPUs?

🚀 1

1

#6 opened 4 months ago by

mancub

New activity in Intel/MiroThinker-v1.5-30B-gguf-q2ks-mixed-AutoRound 3 months ago

Correct metadata, add library name, and link SignRoundV2 paper

#1 opened 4 months ago by

nielsr

New activity in Intel/Qwen3.6-27B-int4-AutoRound 3 months ago

Why delete Intel/Qwen3.6-35B-A3B-int4-AutoRound?

15

#1 opened 4 months ago by

bgeneto

New activity in Intel/Qwen3.6-35B-A3B-int4-mixed-AutoRound 4 months ago

it can use dflash directly with z-lab/Qwen3.6-35B-A3B-Dflash

1

#2 opened 4 months ago by

syvvvv

New activity in Intel/gemma-4-31B-it-int4-AutoRound 4 months ago

Please update chat template

2

#4 opened 4 months ago by

alexcardo

FP4?

1

#5 opened 4 months ago by

alexcardo

New activity in Intel/Qwen3.6-27B-int4-AutoRound 4 months ago

does this even run on intel gpus?

7

#2 opened 4 months ago by

Thomas98519864

New activity in Intel/Qwen3.6-27B-4.5b-mlx-AutoRound 4 months ago

AutoRound quant fails to load with mlx-lm

👍 1

1

#1 opened 4 months ago by

smcleod

New activity in cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit 4 months ago

How does this compare to the original 8bit qwen quant and the 4 bit auto-round quant?

2

#5 opened 5 months ago by

sparx3

New activity in Intel/gemma-4-26B-A4B-it-int4-mixed-AutoRound 4 months ago

any plan for an Ampere compatible version?

2

#2 opened 4 months ago by

electroglyph

New activity in Intel/gemma-4-31B-it-int4-AutoRound 5 months ago

Fails to load on Ampere (sm_86) at TP=2: Marlin kernel rejects 32-dim weight slice

2

#3 opened 5 months ago by

wasifb

New activity in Intel/GLM-4.7-Flash-int4-AutoRound 5 months ago

MTP 0 accept rate

2

#4 opened 5 months ago by

AMUN-RA1

New activity in Intel/gemma-4-31B-it-int4-AutoRound 5 months ago

Installation Video and Testing - Step by Step

🚀 3

5

#1 opened 5 months ago by

fahdmirzac

New activity in Intel/Qwen3.5-397B-A17B-gguf-q2ks-mixed-AutoRound 5 months ago

Performance indicators

👍 4

4

#1 opened 5 months ago by

dehnhaide