Clevyby
/

DarkSapling-v2.0-7B-Q5_K_S-GGUF-iMatrix

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Note:

This repo hosts only a Q5_K_S iMatrix of Dark Sapling v2.0 7B. GGUF quant is from Lewdiculous/DarkSapling-7B-v2.0-GGUF-IQ-Imatrix. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.

Downloads last month: 18

GGUF

Model size

7.24B params

Architecture

llama

5-bit

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.