使用泰国诗格
作者: wannaphong创建于 2026年8月26日更新于 2026年8月26日
I think Thai poetgram in https://GitHub.com/BlinkDL/ChatRWKV/blob/main/tokenizer/rwkv_tokenizer.py#L730. It still can't cover the entire Thai language.
内容来源: BlinkDL/ChatRWKV
I think Thai poetgram in https://GitHub.com/BlinkDL/ChatRWKV/blob/main/tokenizer/rwkv_tokenizer.py#L730. It still can't cover the entire Thai language.
内容来源: BlinkDL/ChatRWKV