Note:

This repo hosts only a Q5_K_S of Fimbulvetr 11b v2. GGUF quant is from mradermacher/Fimbulvetr-11B-v2-GGUF. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.

GGUF

Model size

10.7B params

Architecture

llama

5-bit

Inference Examples

Inference API (serverless) is not available, repository is disabled.

Model tree for Clevyby/Fimbulvetr-11B-v2-Q5_K_S-GGUF

Base model

Quantized

this model