Arche-Codium-500M

Compact, instruction-finetuned code generation model built on Qwen2.5-Coder-0.5B-Instruct. Fast local code completion with minimal resources.

TL;DR

  • 500M parameters โ€” runs on CPU, MPS, or low-VRAM GPU
  • 80% pass rate on HumanEval (16/20 tasks)
  • Apache 2.0 โ€” fully open, commercially usable
  • CLI-ready โ€” plug into arche-code

Live Demo

Try the model directly in your browser โ€” no setup required:

Open in Spaces

Quick Start

With arche-code CLI

git clone https://github.com/OpenSynapseLabs/arche-code.git
cd arche-code
pip install -e .
arche --provider arche --model arche-codium-500m write "def fibonacci(n):" --max-tokens 256

The CLI auto-downloads the model on first use. Full docs: github.com/OpenSynapseLabs/arche-code

With transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "OpenSynapseLabs/arche-codium-500m",
    torch_dtype="auto", device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("OpenSynapseLabs/arche-codium-500m")

prompt = '''def has_close_elements(numbers: list[float], threshold: float) -> bool:
    """Check if any two numbers are closer than threshold."""'''

inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=128, temperature=0.2)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Benchmarks

Benchmark Result
HumanEval 16/20 (80%)

What This Model Is

  • Lead magnet โ€” free, capable entry point into the Arche ecosystem
  • Edge-friendly โ€” runs on laptops, Raspberry Pi, mobile devices
  • Real code โ€” generates executable Python, not just snippets

What This Model Is Not

  • A replacement for 7B+ models on complex architecture tasks
  • A chat model โ€” instruction-tuned for code generation only
  • The final word โ€” larger Arche coding models are shipping this month

Model Details

Property Value
Base model Qwen2.5-Coder-0.5B-Instruct
Parameters 0.49B
License Apache 2.0
Training Instruction fine-tuning on code-completion tasks

Hardware Requirements

Device VRAM/RAM Speed
Apple Silicon (MPS) 2 GB unified ~50 tok/s
NVIDIA GPU (CUDA) 2 GB ~80 tok/s
CPU only 4 GB RAM ~10 tok/s

Limitations

  • Struggles with multi-step reasoning (e.g., LRU cache with TTL)
  • May truncate output at max_tokens limits โ€” increase if code cuts off
  • Hallucinates imports occasionally โ€” always verify generated code
  • Best for functions under 50 lines; breaks down on large classes

Citation

@software{arche_codium_500m,
  author = {Open Synapse Labs},
  title = {Arche-Codium-500M: Compact Code Generation Model},
  year = {2026},
  url = {https://huggingface.co/OpenSynapseLabs/arche-codium-500m}
}

Contact

๐Ÿ“ง opensynapselabs@proton.me
๐Ÿ™ github.com/OpenSynapseLabs


Built by Open Synapse Labs. Base model: Qwen2.5-Coder-0.5B-Instruct (Apache 2.0).

Downloads last month
50
Safetensors
Model size
0.5B params
Tensor type
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ 2 Ask for provider support

Model tree for opensynapselabs/arche3.5-codium-0.5B

Finetuned
(895)
this model
Quantizations
1 model

Space using opensynapselabs/arche3.5-codium-0.5B 1