microsoft

/

Phi-3.5-vision-instruct

like 463

Even SLMs like Phi-3/Phi-3.5 can run on ONNX runtime but still do not support open-source platforms like llama.cpp. Some Devices/OS not supported in time like Mac OS (like x86 arch) can not get the ONNX runtime (like onnxruntime, onnxruntime-genai python lib, etc.). The techs like LongLoPE, Falsh attention, CLIP ViT projector, etc need to be supported by open-source platforms like llama.cpp ASAP. Microsoft needs to give hands to open-source communities to make it happen.