Hugging Face's logo

FallenMerick
/
Space-Whale-Lite-13B-GGUF

Text Generation
GGUF
quantized
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
frankenmerge
Model card Files Community
Edit model card

Space-Whale-Lite-13B

These are GGUF quants for the following model:

https://huggingface.co/FallenMerick/Space-Whale-Lite-13B

Downloads last month
15
GGUF
Model size
13B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Model tree for FallenMerick/Space-Whale-Lite-13B-GGUF

Base model

FallenMerick/Space-Whale-Lite-13B
Quantized
this model

Collection including FallenMerick/Space-Whale-Lite-13B-GGUF