Dipika Sikka

State-of-the-art LLM compression, built for production inference with vLLM

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM