Georgi Gerganov

LLM inference in C/C++

Port of OpenAI's Whisper model in C/C++

Tensor library for machine learning

Locally run an Instruction-Tuned Chat-Style LLM

High-speed Large Language Model Serving for Local Deployment

llama.cpp fork with additional SOTA quants and improved performance

Vim plugin for LLM-assisted code/text completion

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

VS Code extension for LLM-assisted code/text completion

Experimental llama.cpp fork for inference research and development

LLM inference in C/C++