FastChat

工具介绍

一个培训、服务和评价大型语言模型的开放平台。 发回维库纳和查特博特竞技场.

核心特点

• •FastChat powers Chatbot Arena (lmarena.ai), serving over 10 million chat requests for 70+ LLMs.
• •Chatbot Arena has collected over 1.5M human votes from side-by-side LLM battles to compile an online LLM Elo leaderboard.
• •The training and evaluation code for state-of-the-art models (e.g., Vicuna, MT-Bench).
• •A distributed multi-model serving system with web UI and OpenAI-compatible RESTful APIs.
• •[2024/03] 🔥 We released Chatbot Arena technical report.
• •[2023/09] We released LMSYS-Chat-1M, a large-scale real-world LLM conversation dataset. Read the report.
• •[2023/08] We released Vicuna v1.5 based on Llama 2 with 4K and 16K context lengths. Download weights.
• •[2023/07] We released Chatbot Arena Conversations, a dataset containing 33k conversations with human preferences. Download it here.
• •[2023/08] We released LongChat v1.5 based on Llama 2 with 32K context lengths. Download weights.
• •[2023/06] We introduced MT-bench, a challenging multi-turn question set for evaluating chatbots. Check out the blog post.