pinned
Build error
Agents
HeartMuLa
π
A Family of Open Sourced Music Foundation Models
gen
ginigini
AI & ML interests
None yet
Recent Activity
liked a Space 1 day ago
FINAL-Bench/POCKET-Image-Studio reacted to SeaWolf-AI's post with π₯ 3 days ago
POCKET now speaks Gemma 4 β a 26B model that loads in every app, and runs on your PC with no GPU
We're adding a Gemma-4 sibling to POCKET: POCKET-26B, built from Google's Gemma-4-26B-A4B (Apache-2.0). Our flagship POCKET-35B is a Qwen-family MoE and needs a recent llama.cpp; POCKET-26B trades a little size for the thing people kept asking for β it just loads, everywhere, today: Ollama, LM Studio, PocketPal, MLX, any stock llama.cpp. No fork, no bleeding-edge runtime, no CUDA, no cloud.
It's a sparse Mixture-of-Experts (25.2B total, ~4B active per token), so the work per token stays small β a real 26B that generates on a CPU with no graphics card.
Two things make it stand out:
1) Universal compatibility. Gemma 4 is a standard, widely-supported architecture, so POCKET-26B runs on the tools you already have β no waiting for your app to add a new model type.
2) Quality that survives compression. Measured GPQA-Diamond (198 q, greedy):
β’ Full base: 67.7%
β’ POCKET-26B Q4_K_M (17 GB): 67.7% β lossless
β’ POCKET-26B Q2_K (11 GB): 67.2% β near-lossless, at 11 GB
Live, on a CPU-only box (our demo Space β POCKET-26B vs Bonsai-27B, same machine, same stock llama.cpp): POCKET-26B β 19 tok/s vs Bonsai β 6 tok/s β about 3Γ faster generation, no GPU. (Honest notes: shared CPU box, sequential race; a dedicated machine is faster.)
Where it fits in the family:
β’ POCKET-35B (Qwen MoE) β bigger, top-tier, needs a recent llama.cpp.
β’ POCKET-26B (Gemma 4) β loads in any app, quality-robust when compressed. The demo runs the Q4_K_M build; Q2_K (11 GB) is the smallest footprint. For a true β€8 GB phone, the 5 GB POCKET-KR (Qwen) is still the pick.
Try it and grab it:
π₯οΈ Live demo (Gemma4-based, answering on a CPU, no GPU): https://huggingface.co/spaces/FINAL-Bench/POCKET-26B-CPU
π¦ POCKET-26B-GGUF (Q4_K_M 17 GB Β· Q2_K 11 GB): https://huggingface.co/FINAL-Bench/POCKET-26B-GGUF
π POCKET collection: https://huggingface.co/collections/FINAL-Bench/pocket-models liked a Space 3 days ago
FINAL-Bench/POCKET-26B-CPUOrganizations
None yet