Prompt for instruction models to be used in server
Author: lucasjinrealCreated Jun 16, 2023Updated May 24, 2026
Labelsmodelquality
Hi, currently using the API, i can not get a complete reply from client side,
the sentence are stopped at unwanted token, but with cli, it is normal. Why? How to specific prompt template?
Source: abetlen/llama-cpp-python