Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-oQ6-MLX

This repository contains an oMLX oQ6 mixed-precision MLX quantization of llmfan46/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved with both the vision encoder and Native MTP tensors preserved.

This is a replacement build for the earlier Native-MTP-Preserved MLX artifact that preserved MTP but omitted the vision-side tensors. The source VLM config is kept functionally equivalent, with vision_config.model_type patched to qwen3_5 for current MLX-VLM/oMLX compatibility.

Variant

  • Quantization: oQ6
  • Variant: Native MTP Preserved VLM
  • Vision tensors: preserved
  • MTP tensors: preserved
  • Text-only: false
  • Approximate target density: 6.81 bpw.

Usage

omlx serve dawncr0w/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-oQ6-MLX

For direct Python loading, use the VLM loader from the bundled oMLX/MLX-VLM runtime.

Validation

Local validation completed with the bundled oMLX runtime:

loader: mlx_vlm.load_model with oMLX VLM/MTP patches
load smoke test: passed
peak memory: 22.089 GB
visual tensors: 333
mtp tensors: 29

Source

Upstream model card license tag: apache-2.0.

Downloads last month
658
Safetensors
Model size
7B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dawncr0w/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-oQ6-MLX

Collection including dawncr0w/Qwen3.6-27B-uncensored-heretic-v2-Native-MTP-Preserved-oQ6-MLX