← Developers
Open on GitHub 


#4001 1
Mark Kurtz
@markurtz · USA
6.23k
Weighted score
794
Contributions
5
Repos
Top repos
- vllm-project/llm-compressor
- neuralmagic/sparseml
- vllm-project/guidellm
- neuralmagic/deepsparse
- vllm-project/speculators
Ranked AI repos3
14911201
vllm-project/llm-compressor
+5
State-of-the-art LLM compression, built for production inference with vLLM
3.85k· Python· Infrastructure
7390713
neuralmagic/sparseml
+0
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
2.14k· Python· Infrastructure
4069340
vllm-project/guidellm
+1
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
1.66k· Python· AI Engineering