Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

41,451

Full-text search

Active filters: bitsandbytes

hoangphu7122002ai/merge_model_test

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/VAGOsolutions_-_SauerkrautLM-Mixtral-8x7B-Instruct-4bits

Text Generation • 47B • Updated May 3, 2024

RichardErkhov/Locutusque_-_gpt2-xl-conversational-4bits

Text Generation • 2B • Updated May 3, 2024 • 1

RichardErkhov/Locutusque_-_gpt2-xl-conversational-8bits

Text Generation • 2B • Updated May 3, 2024

AIAT/The_Scamper-opt70bqt

Table Question Answering • 71B • Updated May 3, 2024 • 1

Kameshr/LLAMA-3-Quantized

Text Generation • 8B • Updated May 3, 2024 • 3 • 9

supriyaupadhyaya/llama-3-8b-bnb-4bit-text-to-sql-old

Text Generation • 8B • Updated May 3, 2024

RichardErkhov/JackFram_-_llama-160m-4bits

Text Generation • 0.2B • Updated May 3, 2024 • 1

RichardErkhov/JackFram_-_llama-160m-8bits

Text Generation • 0.2B • Updated May 3, 2024 • 1

RichardErkhov/Locutusque_-_OpenCerebrum-1.0-7b-DPO-4bits

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/Locutusque_-_OpenCerebrum-1.0-7b-DPO-8bits

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-4bits

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/Azurro_-_APT3-1B-Base-4bits

Text Generation • 1B • Updated May 3, 2024

RichardErkhov/Azurro_-_APT3-1B-Base-8bits

Text Generation • 1B • Updated May 3, 2024 • 1

RichardErkhov/Nondzu_-_zephyr-speakleash-010-pl-3072-32-16-0.01-8bits

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/state-spaces_-_mamba-130m-hf-4bits

Text Generation • 0.1B • Updated May 3, 2024 • 2

RichardErkhov/state-spaces_-_mamba-130m-hf-8bits

Text Generation • 0.1B • Updated May 3, 2024 • 9

DuongTrongChi/opp

Text Generation • 0.6B • Updated May 3, 2024 • 1

hackint0sh/phi-3-clinical-finetuned

Text Generation • 4B • Updated May 3, 2024 • 2

RichardErkhov/CohereForAI_-_c4ai-command-r-v01-4bits

Text Generation • 35B • Updated May 3, 2024 • 22

RichardErkhov/mistral-community_-_Mistral-7B-v0.2-4bits

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/unsloth_-_llama-3-8b-Instruct-bnb-4bit-4bits

Text Generation • 8B • Updated May 3, 2024 • 1

RichardErkhov/mistral-community_-_Mistral-7B-v0.2-8bits

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/unsloth_-_llama-3-8b-Instruct-bnb-4bit-8bits

Text Generation • 8B • Updated May 3, 2024 • 1

RichardErkhov/Gustavosta_-_MagicPrompt-Stable-Diffusion-4bits

Text Generation • 0.1B • Updated May 3, 2024 • 1

RichardErkhov/Gustavosta_-_MagicPrompt-Stable-Diffusion-8bits

Text Generation • 0.1B • Updated May 3, 2024

hackint0sh/Hello-World

Text Generation • 4B • Updated May 3, 2024 • 1

dbands/Phi-3-mini-4k-code-instructions-122k-alpaca-style-4bit

Text Generation • 4B • Updated May 3, 2024 • 2

RichardErkhov/m-a-p_-_OpenCodeInterpreter-DS-6.7B-4bits

Text Generation • 7B • Updated May 3, 2024 • 1

RichardErkhov/stabilityai_-_stablelm-2-zephyr-1_6b-4bits

Text Generation • 2B • Updated May 3, 2024 • 1