Issue with Phi-3 Mini 4K Instruct Response Format

#93
by adameda - opened

I'm experiencing an issue with the Phi-3 Mini 4K Instruct model. The responses I get include the prompt and input along with the answer, resulting in unnecessarily long outputs. Even when I specify in the prompt that I only want the answer, the problem persists.

I’m not sure if this is an inherent behavior or if there's a way to adjust the model to provide only the answer. Does anyone have any insights or suggestions on how to address this?

Sign up or log in to comment