--- language: - en --- # LLaMA3-LLaVA-NeXT-8B GGUF files GGUF version of https://huggingface.co/lmms-lab/llama3-llava-next-8b
download the mmproj-model-f16.gguf and any quant you want of llama3-llava-next-8b-*.gguf Follow the [readme from llama.cpp](https://github.com/ggerganov/llama.cpp/blob/master/examples/llava/README.md)
or the [readme from llama-cpp-python](https://github.com/abetlen/llama-cpp-python?tab=readme-ov-file#multi-modal-models)