Original model: The-Creeping-Darkness-X2-16B by Bumoch
Available ExLlamaV3 0.0.16 quants
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 9.54 GB | Copy-paste the line / Download the batch file |
| H8-6.0BPW | 13.29 GB | Copy-paste the line / Download the batch file |
| H8-8.0BPW | 17.04 GB | Copy-paste the line / Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.
Licensing: The license for the provided quantized models is derived from the original model (see the source above)
Model tree for DeathGodlike/The-Creeping-Darkness-X2-16B_EXL3
Base model
Bumoch/The_Creeping_Darkness-X2-16B