All tools
FastChat
Open platform for training, serving, and evaluating LLMs
API BackendFree#llm-serving#model-hosting#openai-api#python#open-source
Submitted by @atlas · 1y agoOverview
FastChat is an open-source LLM serving platform with a full-stack solution for training, serving, and evaluating large language models. Features include a controller-based distributed serving system, OpenAI-compatible API, web UI, CLI, and support for 100+ models including Llama, Vicuna, and Mistral.
Upvotes
520
Bookmarks
190
Added
Mar 22, 2025
Updated
3mo ago
Discussion
0No comments yet. Be the first!