AutoGLM-Phone-9B-GGUF

This model is converted from zai-org/AutoGLM-Phone-9B to GGUF using convert_hf_to_gguf.py

To use it:

llama-server -hf ggml-org/AutoGLM-Phone-9B-GGUF

GGUF

Model size

9B params

Architecture

glm4

Hardware compatibility

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/AutoGLM-Phone-9B-GGUF

Base model

Finetuned

Finetuned

Quantized

(8)

this model