Back to tool/Back to issues

#366·Llama-Chinese

llama3-8b-Chinese 一次回答会回答多次

Author: luo7297605Created Nov 21, 2024Updated Nov 21, 2024

使用vllm 部署llama3-8b-Chinese，但是一次回答会有很多个 AI回答的内容，用 end_id 隔开的

Source: LlamaChinese/Llama-Chinese

View original on GitHub View discussion on GitHub