Could you please make this model?

#1
by Hoioi - opened

Thank you so much for your great models. I could find some of the best GGML models on your profile that I've been looking forward for them and couldn't find them so far. You really are the best.
I have a request from you too. Could you please make the GGML version of llava model? It's really awesome and many people are looking for it, but the normal installation process is so difficult for beginners.
The link to the installation process and files is:
https://github.com/haotian-liu/LLaVA

And the demo is available here:
https://llava.hliu.cc/

If it can be quantized I'm not sure any GUI supports it.

It seems to quantize fine and generates text fine. Idk how you'll get it to take images as an input though.

https://huggingface.co/xzuyn/LLaVa-v1.1-13B-GGML

xzuyn changed discussion status to closed

Sign up or log in to comment