Clevyby
/

Lumimaid-8B-v0.1-OAS-Q5_K_S-GGUF-iMatrix

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Note:

This repo hosts only a Q5_K_S iMatrix of Llama 3 Lumimaid 8B v0.1 OAS. GGUF quant is from Lewdiculous/Llama-3-Lumimaid-8B-v0.1-OAS-GGUF-IQ-Imatrix. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.

Downloads last month: 29

GGUF

Model size

8.03B params

Architecture

llama

5-bit

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.