Prompt for instruction models to be used in server

Author: lucasjinrealCreated Jun 16, 2023Updated May 24, 2026
Labelsmodelquality

Hi, currently using the API, i can not get a complete reply from client side,

the sentence are stopped at unwanted token, but with cli, it is normal. Why? How to specific prompt template?

Source: abetlen/llama-cpp-python