FastChat is an open platform for training, benchmarking, and serving chatbots with LLMs. It offers an OpenAI-compatible REST API, WebUI, CLI, and SOTA models like Vicuna and evaluation tools.
FastChat provides an open platform for building and running conversational AI services powered by large language models (LLMs). 🤖
⚙️ Flexible deployment - CLI, WebUI, and production-grade APIs
✨ SOTA models - Weights and tooling for top-performing chatbots like Vicuna
📊 Built-in benchmarking - Standardized multi-turn QA evaluations
🏆 Model battles - Online arena to compete LLMs with human votes
🔬 Modularity - Mix specialized models and connect custom data/tools
The goal is maximum leverage for developers and researchers to build, test, and deploy LLMs as customizable conversational interfaces. 🚀 FastChat combines all the pieces you need to create next-gen search assistants, virtual tutors, gaming bots, and more.
- ⚡️ Productivity - 10x faster prototyping with prebuilt capabilities like Vicuna and battle-tested modules.
- 🧪 Customization - Modular design allows integrating custom models, data, and tools with no code change.
- 🔌 Flexibility - Easily switch serving deployment from CLI to API endpoint to UI with no change.
- 📊 Benchmarking - Standardized evaluations using tools like MT-bench across models.
- 👥 Community - Join researchers and engineers collaborating to push SOTA in conversational AI.
In summary, FastChat accelerates building real-world chatbot applications through high-leverage frameworks forged by top minds in academia and industry. Whether creating assistants or gaming bots, it unlocks productivity.
- 👷🏽♀️ Builders: Lianmin Zheng, Wei-Lin Chiang, Siyuan (Ryan) Zhuang, Ying Sheng
- 👩🏽💼 Builders on LinkedIn: https://www.linkedin.com/in/lianmin-zheng-6266a8114/, https://www.linkedin.com/in/wei-lin-chiang-51b025b2/, https://www.linkedin.com/in/siyuanzhuang, https://www.linkedin.com/in/yingsheng1123/
- 👩🏽🏭 Builders on X: https://twitter.com/lm_zheng, https://twitter.com/infwinston
- 💾 Used in 221 repositories
- 👩🏽💻 Contributors: 206
- 💫 GitHub Stars: 30.1k
- 🍴 Forks: 3.7k
- 👁️ Watch: 317
- 🪪 License: Apache-2.0
- 🔗 Links: Below 👇🏽
- GitHub Repository: https://github.com/lm-sys/FastChat
- Official Website: https://lmsys.org/blog/2023-05-03-arena/
- Discord Server: https://discord.com/invite/HSWAKCrnFx
- X Page: https://twitter.com/lmsysorg
- Profile in The AI Engineer: https://github.com/theaiengineer/awesome-opensource-ai-engineering/blob/main/libraries/fastchat.md
🧙🏽 Follow The AI Engineer for more about FastChat and daily insights tailored to AI engineers. Subscribe to our newsletter. We are the AI community for hackers!
♻️ Repost this to help FastChat become more popular. Support AI Open-Source Libraries!