← 开发者
在 GitHub 打开 


#836 1
Woosuk Kwon
@WoosukKwon · USA
21.7k
加权贡献
2.54k
贡献次数
5
项目数
主要项目
- vllm-project/vllm
- weicj/vLLM-2080Ti-Definitive
- 1CatAI/1Cat-vLLM
- skypilot-org/skypilot
- alpa-projects/alpa
上榜的 AI 项目3
23531
vllm-project/vllm
+51
A high-throughput and memory-efficient inference and serving engine for LLMs
93.2k· Python· Infrastructure
10265
1CatAI/1Cat-vLLM
+9
V100 / SM70-focused vLLM engineering fork for modern LLM inference.
1.23k· Python· Infrastructure
1245222
weicj/vLLM-2080Ti-Definitive
+7
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )
1.09k· Python· Infrastructure