Lianmin Zheng

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

SGLang is a high-performance serving framework for large language models and multimodal models.

Running large language models on a single GPU for throughput-oriented scenarios.

Training and serving large-scale neural networks with auto parallelization.

A list of awesome compiler projects and papers for tensor computation and deep learning.

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

A Platform for Many-Agent Reinforcement Learning