awesome-llm
A curated list of awesome LLM frameworks, libraries and software.
- Learning and Reference
- Language and Tooling
- Web
- Data and Storage
- Machine Learning and AI
- AI Agents
- User Interface
- Graphics and Media
- Security
- Concurrency and Performance
- Utilities
- Business and Domain
- Other
Learning and Reference
Tutorials and Books
- rasbt/LLMs-from-scratch - Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
- mlabonne/llm-course - Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
- datawhalechina/hello-agents - 📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程
- shareAI-lab/learn-claude-code - Bash is all you need - A nano claude code–like 「agent harness」, built from 0 to 1
- jingyaogong/minimind - 🧠 Train a 64M-parameter LLM from scratch in just 2h!
- rohitg00/ai-engineering-from-scratch - Learn it. Build it. Ship it for others.
- Lordog/dive-into-llms - 《动手学大模型Dive into LLMs》系列编程实践教程
- bojieli/ai-agent-book - 《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
- patchy631/ai-engineering-hub - In-depth tutorials on LLMs, RAGs and real-world AI agent applications.
- karpathy/LLM101n - LLM101n: Let's build a Storyteller (archived)
- datawhalechina/happy-llm - 📚 从零开始构建大模型
- datawhalechina/self-llm - 《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程
- NirDiamant/RAG_Techniques - This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.
- HandsOnLLM/Hands-On-Large-Language-Models - Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
- humanlayer/12-factor-agents - What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?
- liguodongiot/llm-action - 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
- datawhalechina/llm-cookbook - 面向开发者的 LLM 入门教程,吴恩达大模型系列课程中文版
- NirDiamant/GenAI_Agents - 50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.
- AccumulateMore/CV - ✅(已完结)超级全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】
- NirDiamant/agents-towards-production - End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.
- liyupi/ai-guide - 程序员鱼皮的 AI 资源大全 + Vibe Coding 零基础教程,分享 OpenClaw 保姆级教程、大模型玩法(DeepSeek / GPT / Gemini / Claude / GLM)、最新 AI 资讯、Prompt 提示词大全、AI 知识百科(Agent Skills / RAG / MCP / A2A)、AI 编程教程(Harness Engineering)、AI 工具用法(Cursor / Claude Code / TRAE / Codex / Copilot)、AI 开发框架教程(Spring AI / LangChain)、AI 产品变现指南,帮你快速掌握 AI 技术,走在时代前沿。本项目为开源文档 aiguide,已升级为鱼皮 AI 导航网站
- datawhalechina/easy-vibe - 💻 vibe coding 101|The first course for AI-native product builders.
- stas00/ml-engineering - Machine Learning Engineering Open Book
- ZJU-LLMs/Foundations-of-LLMs - A book for Learning the Foundations of LLMs
- walkinglabs/learn-harness-engineering - Harness engineering beginner tutorial, from 0 to 1
- datawhalechina/llm-universe - 本项目是一个面向小白开发者的大模型应用开发教程,在线阅读地址:https://datawhalechina.github.io/llm-universe/
- halfrost/Halfrost-Field - ✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地:源码解析、系统设计与工程实践笔记
- The-Pocket/PocketFlow-Tutorial-Codebase-Knowledge - Pocket Flow: Codebase to Tutorial
- RUCAIBox/LLMSurvey - The official GitHub page for the survey paper "A Survey of Large Language Models".
- cobusgreyling/loop-engineering - Practical patterns, starters & CLI tools for loop engineering with AI coding agents. Design systems that prompt and orchestrate agents (inspired by Addy Osmani and Boris Cherny). Includes loop-audit, loop-init, loop-cost.
- datawhalechina/all-in-rag - 🔍大模型应用开发实战一:RAG 技术全栈指南,在线阅读地址:https://datawhalechina.github.io/all-in-rag/
- FareedKhan-dev/train-llm-from-scratch - A straightforward method for training your LLM, from downloading data to generating text.
- adongwanai/AgentGuide - https://adongwanai.github.io/AgentGuide | AI Agent开发指南 | LangGraph实战 | 高级RAG | 转行大模型 | 大模型面试 | 算法工程师 | 面试题库 | 强化学习|数据合成
- poloclub/transformer-explainer - Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
- liyupi/codefather - 程序员鱼皮的编程宝典 ⭐️ 2026年最全编程学习路线图!包含Java学习路线、前端学习路线、Python学习路线、C++学习路线、算法学习路线、计算机基础学习路线、AI应用开发学习路线、AI Agent开发学习路线等。提供编程入门教程、AI大模型应用开发教程、RAG开发实战、MCP开发教程、Prompt工程指南、LLM应用开发、技术知识分享、学习资源推荐、项目实战教程、热门面试题、求职经验、简历优化、编程自学指南等内容,适用于所有零基础学编程、学习AI开发、转行程序员、计算机专业学生、求职找工作的同学 💎 编程学习,就来编程导航!
- NirDiamant/Prompt_Engineering - 22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.
- ed-donner/llm_engineering - Repo to accompany my mastering LLM engineering course
- luhengshiwo/LLMForEverybody - 每个人都能看懂的大模型知识分享,LLMs春/秋招大模型面试前必看,让你和面试官侃侃而谈
- DataTalksClub/llm-zoomcamp - LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base. Register here 👇🏼
- nndl/llm-beginner - 《大模型与智能体》电子书与 6 个编程任务:Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。
- ashishps1/learn-ai-engineering - Learn AI and LLMs from scratch using free resources
- FlorianBruniaux/claude-code-ultimate-guide - The most comprehensive Claude Code guide: agentic workflows, hooks, skills, MCP servers, quizzes, and production-ready templates. 430K+ lines.
- bbycroft/llm-viz - 3D Visualization of an GPT-style LLM
- PacktPublishing/LLM-Engineers-Handbook - The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices
- rasbt/reasoning-from-scratch - Implement a reasoning LLM in PyTorch from scratch, step by step
- sgl-project/mini-sglang - A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
- changyeyu/LLM-RL-Visualized - 🌟100+ 原创 LLM / RL 原理图📚,《大模型算法》作者巨献!💥(100+ LLM/RL Algorithm Maps )
- pguso/ai-agents-from-scratch - Demystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns.
- didilili/ai-agents-from-zero - 🚀 2026 最系统的 AI Agent 速成指南|智能体实战教程 · 完整学习路径 + 实战项目 + 面试题库 · 对标大模型应用开发工程师岗位 · 覆盖LangChain / LangGraph / Coze / Dify / MCP / skills / LLM / RAG / 提示词 · 企业级部署与微调 · 从0到企业级落地 + 从学习到上线项目 + 面试准备一体化
- trigaten/Learn_Prompting - Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
- origin-brain/beat-ai - 不玩晦涩不搞少数派的 AI 入门圣经,从学生到工程师都能轻松掌握。涵盖神经网络到大模型、顶层设计到微观原理、工程实现到算法基础。 学完后,大家能彻底看懂为什么下一 token 预测这个看似不起眼的能力可以改变世界,也能发现原来 AI 并没有想象中那么神秘、那么高不可攀。 Let's just beat it !
- TingsongYu/PyTorch-Tutorial-2nd - 《Pytorch实用教程》(第二版)无论是零基础入门,还是CV、NLP、LLM项目应用,或是进阶工程化部署落地,在这里都有。相信在本书的帮助下,读者将能够轻松掌握 PyTorch 的使用,成为一名优秀的深度学习工程师。
- Hoper-J/AI-Guide-and-Demos-zh_CN - 这是一份入门AI/LLM大模型的逐步指南,包含教程和演示代码,带你从API走进本地大模型部署和微调,代码文件会提供Kaggle或Colab在线版本,即便没有显卡也可以进行学习。项目中还开设了一个小型的代码游乐场🎡,你可以尝试在里面实验一些有意思的AI脚本。同时,包含李宏毅 (HUNG-YI LEE)2024生成式人工智能导论课程的完整中文镜像作业。
- skyzh/tiny-llm - learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
- LLMBook-zh/LLMBook-zh.github.io - 《大语言模型》作者:赵鑫,李军毅,周昆,唐天一,文继荣
- walkinglabs/hands-on-modern-rl - 🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.
- decodingai-magazine/llm-twin-course - 🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴
- datawhalechina/llms-from-scratch-cn - 仅需Python基础,从0构建大语言模型;从0逐步构建GLM4\Llama3\RWKV6, 深入理解大模型原理
- ray-project/llm-numbers - Numbers every LLM developer should know
- lintsinghua/claude-code-book - 《御舆:解码 Agent Harness》42万字拆解 AI Agent 的Harness骨架与神经 —— Claude Code 架构深度剖析,15 章从对话循环到构建你自己的 Agent Harness。在线阅读网站:
- GiovanniPasq/agentic-rag-for-dummies - A modular Agentic RAG built with LangGraph — learn Retrieval-Augmented Generation Agents in minutes.
- bragai/bRAG-langchain - Everything you need to know to build your own RAG application
- hemansnation/AI-Engineer-Headquarters - A collection of scientific methods, processes, algorithms, and systems to build stories & models.
- Windy3f3f3f3f/how-claude-code-works - Deep dive into Claude Code internals — architecture, agent loop, context engineering, and more. / 深入解析 Claude Code 源码:架构、Agent 循环、上下文工程、工具系统等
- wyf3/llm_related - 复现大模型相关算法及一些学习记录
- iusztinpaul/hands-on-llms - 🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴 (archived)
- angelos-p/llm-from-scratch
- raiyanyahya/how-to-train-your-gpt - Build a modern LLM from scratch. Every line commented. Explained like we are five.
- ombharatiya/ai-system-design-guide - AI system design guide for engineers building production AI systems and evals.
- wquguru/harness-books - 📚 Two books on harness engineering — the design philosophies behind Claude Code & Codex: constraints, query loops, context governance, multi-agent verification. harness-books.agentway.dev
- AlephAITech/WorkBuddyGuide - A practical, open-source guide to mastering WorkBuddy through real-world workflows.开源的 WorkBuddy 实战蓝皮书:教程、真实工作流、Skills、MCP、自动化与多智能体实践。
- decodingai-magazine/second-brain-ai-assistant-course - Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.
- datawhalechina/hugging-llm - HuggingLLM, Hugging Future.
- bbruceyuan/Hands-On-Large-Language-Models-CN - 中文翻译的 Hands-On-Large-Language-Models (hands-on-llms),动手学习大模型
- MLNLP-World/LLMs-from-scratch-CN - LLMs-from-scratch项目中文翻译
- loveunk/deep-learning-llm-agent-notes - 机器学习、深度学习的学习路径及知识总结
- automata/aicodeguide - AI Code Guide is a roadmap to start coding with AI
- Windy3f3f3f3f/claude-code-from-scratch - Build your own Claude Code from scratch. 🔍 Claude Code 开源了 50 万行代码,读不动?用 ~5000 行 TypeScript / Python 从零复现核心架构,11 章分步教程带你理解 coding agent 精髓
- echonoshy/cgft-llm - Practice to LLM.
- athina-ai/rag-cookbooks - This repository contains various advanced techniques for Retrieval-Augmented Generation (RAG) systems.
- datawhalechina/handy-ollama - 动手学Ollama,CPU玩转大模型部署,在线阅读地址:https://datawhalechina.github.io/handy-ollama/
- howl-anderson/unlocking-the-power-of-llms - 使用 Prompts 和 Chains 让 ChatGPT 成为神奇的生产力工具!Unlocking the power of LLMs.
- hamzafarooq/building-llm-applications-from-scratch - Code and Slides
- adithya-s-k/AI-Engineering.academy - Mastering Applied AI, One Concept at a Time
- hesamsheikh/ml-retreat - Machine Learning Journal for Intermediate to Advanced Topics.
Examples and Exercises
- pathwaycom/llm-app - Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
- GoogleCloudPlatform/generative-ai - Sample code and notebooks for Generative AI on Google Cloud, with Gemini Enterprise Agent Platform
- wdndev/llm_interview_note - 主要记录大语言大模型(LLMs) 算法(应用)工程师相关的知识及面试题
- e2b-dev/fragments - Open-source Next.js template for building apps that are fully generated by AI. By E2B.
- liyupi/mianshiya - 持续维护的企业面试题库网站,帮你拿到满意 offer!⭐️ 2026年最新Java面试题、前端面试题、AI大模型面试题、AI Agent面试题、RAG面试题、C++面试题、Go面试题、Python面试题、测试面试题、运维面试题、后端面试题、操作系统面试题、计算机网络面试题、Redis面试题、MySQL数据库面试题、算法面试题、Spring面试题、JVM面试题、Java并发面试题、Linux面试题、LLM面试题、Prompt工程面试题、系统设计面试题等1万多道高频程序员求职必备八股文。面试刷题就选面试鸭 💎 React 前端 + Node 后端 + 云开发全栈项目 by 程序员鱼皮
- WeThinkIn/AIGC-Interview-Book - 【三年面试五年模拟】AIGC/LLM/AI Agent算法工程师面试资源平台。涵盖AIGC、LLM大模型、AI Agent、具身智能、传统深度学习、计算机视觉、自然语言处理、自动驾驶、机器学习、强化学习、大数据挖掘、世界模型、元宇宙、AGI等AI行业面试笔试干货经验与核心跨周期知识。
- FareedKhan-dev/all-agentic-architectures - 35 production-grade agentic AI architectures (Reflexion, LATS, GraphRAG, MemGPT, Voyager, BrowserAgent, ...) — a Python library and runnable textbook with multi-provider LLM support and a 17-task benchmark leaderboard.
- daveebbelaar/ai-cookbook - Examples and tutorials to help developers build AI systems
- NVIDIA/GenerativeAIExamples - Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
- datawhalechina/daily-interview - Datawhale成员整理的面经,内容包括机器学习,CV,NLP,推荐,开发等,欢迎大家star
- NVIDIA/ChatRTX - A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM (archived)
- amitshekhariitbhu/ai-engineering-interview-questions - Your Cheat Sheet for AI Engineering Interview – Questions and Answers.
- pinecone-io/examples - Jupyter Notebooks to help you get hands-on with Pinecone vector databases
- ashishpatel26/LLM-Finetuning - LLM Finetuning with peft
- 315386775/DeepLearing-Interview-Awesome-2024 - AIGC-interview/CV-interview/LLMs-interview面试问题与答案集合仓,同时包含工作和科研过程中的新想法、新问题、新资源与新项目
- km1994/LLMs_interview_notes - 该仓库主要记录 大模型(LLMs) 算法工程师相关的面试题
- Exorust/TorchLeet - LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.
- milvus-io/bootcamp - Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
Awesome Lists and Collections
- Shubhamsaboo/awesome-llm-apps - 100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.
- asgeirtj/system_prompts_leaks - Extracted system prompts from Anthropic - Claude Fable 5.1, Opus 5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-6-Astra, Codex. Google - Gemini 3.8 Flash, 3.1 Pro, Antigravity. xAI - Grok, Grok Bot, Cursor, Kimi and more! Updated regularly.
- hesreallyhim/awesome-claude-code - A hand-picked collection of the finest of resources for the most awesome of agents, Claude Code, the undisputed champion of coding companions, from the unstoppable team at Anthropic PBC. A delectable showcase of top tier skills, ambidextrous agents, scintillating status lines, top notch developer tooling, and also we have plugins
- Hannibal046/Awesome-LLM - Awesome-LLM: a curated list of Large Language Model
- mikeroyal/Self-Hosting-Guide - Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.
- AiHubCN/Awesome-Chinese-LLM - 整理开源的中文大语言模型,以规模较小、可私有化部署、训练成本较低的模型为主,包括底座模型,垂直领域微调及应用,数据集与教程等。
- davideuler/architecture.of.internet-product - 互联网公司技术架构,微信/淘宝/微博/腾讯/阿里/美团点评/百度/OpenAI/Google/Facebook/Amazon/eBay的架构,欢迎PR补充
- Arindam200/awesome-ai-apps - A collection of projects showcasing RAG, agents, workflows, and other AI use cases
- jujumilk3/leaked-system-prompts - Collection of leaked system prompts
- eugeneyan/open-llms - 📋 A list of open LLMs available for commercial use.
- steven2358/awesome-generative-ai - A curated list of modern Generative Artificial Intelligence projects and services
- KalyanKS-NLP/llm-engineer-toolkit - A curated list of 120+ LLM libraries category wise.
- Mooler0410/LLMsPracticalGuide - A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
- kyrolabs/awesome-langchain - 😎 Awesome list of tools and projects with the awesome LangChain framework
- yzhao062/anomaly-detection-resources - Anomaly detection related books, papers, videos, and toolboxes. Last update late 2025 for LLM and VLM works!
- WangRongsheng/awesome-LLM-resources - 🧑🚀 全世界最好的LLM资料总结(多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型) | Summary of the world's best LLM resources.
- WooooDyy/LLM-Agent-Paper-List - The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.
- mnfst/awesome-free-llm-apis - List of Permanent Free LLM API (API Keys)
- WenyuChiou/awesome-agentic-ai-zh - A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
- hijkzzz/Awesome-LLM-Strawberry - A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.
- fr0gger/Awesome-GPT-Agents - A curated list of GPT agents for cybersecurity
- georgezouq/awesome-ai-in-finance - 🔬 A curated list of awesome LLMs & deep learning strategies & tools in financial market.
- wgwang/awesome-LLMs-In-China - 中国大模型
- heilcheng/awesome-agent-skills - Tutorials, Guides and Agent Skills Directories
- ikaijua/Awesome-AITools - Collection of AI-related utilities. Welcome to submit pull requests /收藏AI相关的实用工具,欢迎提交pull requests
- tensorchord/Awesome-LLMOps - An awesome & curated list of best LLMOps tools for developers
- lonePatient/awesome-pretrained-chinese-nlp-models - Awesome Pretrained Chinese NLP Models,高质量中文预训练模型&大模型&多模态模型&大语言模型集合
- xlite-dev/Awesome-LLM-Inference - 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
- 0xeb/TheBigPromptLibrary - A collection of prompts, system prompts and LLM instructions
- SylphAI-Inc/LLM-engineer-handbook - A curated list of Large Language Model resources, covering model training, serving, fine-tuning, and building LLM applications.
- mlabonne/llm-datasets - Curated list of datasets and tools for post-training.
- alvinreal/awesome-opensource-ai - Curated list of the best truly open-source AI projects, models, tools, and infrastructure. Daily updated.
- luban-agi/Awesome-AIGC-Tutorials - Curated tutorials and resources for Large Language Models, AI Painting, and more.
- GT-RIPL/Awesome-LLM-Robotics - A comprehensive list of papers using large language/multi-modal models for Robotics/RL, including papers, codes, and related websites
- AlexAnys/awesome-openclaw-usecases-zh - 🇨🇳 OpenClaw中文用例大全 | 50个真实场景 | 国内特色 + 海外案例的国内适配 | 自动化办公·内容创作·运维·AI助理·知识管理 | 新手友好
- HuaizhengZhang/AI-Infra-from-Zero-to-Hero - 🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
- eseckel/ai-for-grant-writing - A curated list of resources for using LLMs to develop more competitive grant applications.
- walkinglabs/awesome-harness-engineering - 🛠️ Awesome tools & guides for harness engineering.
- killop/anything_about_game - A wonderful list of Game Development resources.
- billmei/every-chatgpt-gui - Every front-end GUI client for ChatGPT, Claude, and other LLMs
- mergisi/awesome-openclaw-agents - 162 production-ready AI agent templates for OpenClaw. SOUL.md configs across 19 categories. Submit yours!
- eosphoros-ai/Awesome-Text2SQL - Curated tutorials and resources for Large Language Models, Text2SQL, Text2DSL、Text2API、Text2Vis and more.
- cbamls/AI_Tutorial - 大厂发布的AI落地实践、顶尖实验室的最新论文、工业界的真实踩坑记录
- atfortes/Awesome-LLM-Reasoning - From Chain-of-Thought prompting to OpenAI o1 and DeepSeek-R1 🍓
- filipecalegario/awesome-generative-ai - A curated list of Generative AI tools, works, models, and references
- codefuse-ai/Awesome-Code-LLM - [TMLR] A curated list of language modeling researches for code (and other software engineering activities), plus related datasets.
- DSXiangLi/DecryptPrompt - 总结Prompt&LLM论文,开源数据&模型,AIGC应用
- Zjh-819/LLMDataHub - A quick guide (especially) for trending instruction finetuning datasets
- Sumanth077/ai-engineering-toolkit - A curated list of 100+ libraries and frameworks for AI engineers building with LLMs
- Meirtz/Awesome-Context-Engineering - 🔥 Comprehensive survey on Context Engineering: from prompt engineering to production-grade AI systems. hundreds of papers, frameworks, and implementation guides for LLMs and AI agents.
- yunlong10/Awesome-LLMs-for-Video-Understanding - 🔥🔥🔥 [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.
- taishi-i/awesome-ChatGPT-repositories - A curated list of open source GitHub repositories related to ChatGPT, the OpenAI API, and Codex. Searchable via Claude Code skills.
- zjunlp/LLMAgentPapers - Must-read Papers on LLM Agents.
- open-free-llm-api/awesome-freellm-apis - 134+ free LLM APIs & AI API keys from 40+ providers. Google Gemini, NVIDIA NIM, Groq, OpenRouter & more. One-click setup for Claude Code, Cursor and Codex.
- Paitesanshi/LLM-Agent-Survey
- FreedomIntelligence/Awesome-AI4Med - A curated list of medical LLMs, multimodal systems, datasets, benchmarks, and more. 🏥
- rafska/awesome-local-llm - A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
- luo-junyu/Awesome-Agent-Papers - [Up-to-date] Large Language Model Agent: A Survey on Methodology, Applications and Challenges
- underlines/awesome-ml - Curated list of useful LLM / Analytics / Datascience resources
- InterviewReady/ai-engineering-resources - Research papers and blogs to transition to AI Engineering
- RManLuo/Awesome-LLM-KG - Awesome papers about unifying LLMs and KGs
- guyulongcs/Awesome-Deep-Learning-Papers-for-Search-Recommendation-Advertising - Awesome Deep Learning papers for industrial Search, Recommendation and Advertisement. They focus on Embedding, Matching, Pre-Ranking, Ranking, Post Ranking, Relevance, LLM and RL. Please cite our paper "Deep Learning to Rank in Industrial Search Engines, Recommender Systems, and Online Advertising - An Overview and New Perspectives" (TOIS 2026).
- luban-agi/Awesome-Domain-LLM - 收集和梳理垂直领域的开源模型、数据集及评测基准。
- mbzuai-oryx/Awesome-LLM-Post-training - Awesome Reasoning LLM Tutorial/Survey/Guide
- TsinghuaC3I/Awesome-RL-for-LRMs - A Survey of Reinforcement Learning for Large Reasoning Models
- XiaoxinHe/Awesome-Graph-LLM - A collection of AWESOME things about Graph-Related LLMs.
- AGI-Edgerunners/LLM-Agents-Papers - A repo lists papers related to LLM based agent
Language and Tooling
Editor and IDE Support
- voideditor/void - (archived)
- olimorris/codecompanion.nvim - ✨ AI Coding, Vim Style
- PawanOsman/OpenCursor - Open-source Cursor-like AI coding agent for VS Code - agentic chat, multi-provider LLMs (OpenAI, Ollama, llama.cpp), semantic search, and MCP support
- kodu-ai/claude-coder - Kodu is an autonomous coding agent that lives in your IDE. It is a VSCode extension that can help you build your dream project step by step by leveraging the latest technologies in automated coding agents
- karthink/gptel - A simple, extensible LLM client for Emacs
- SilasMarvin/lsp-ai - LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
- nicepkg/aide - Conquer Any Code in VSCode: One-Click Comments, Conversions, UI-to-Code, and AI Batch Processing of Files! 在 VSCode 中征服任何代码:一键注释、转换、UI 图生成代码、AI 批量处理文件!💪
Version Control
- alibaba/open-code-review - Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.
- idosal/git-mcp - Put an end to code hallucinations! GitMCP is a free, open-source, remote MCP server for any GitHub project
- di-sukharev/opencommit - top #1 and most feature rich GPT wrapper for git — generate commit messages with an LLM in 1 sec — works with Claude, GPT and every other provider, supports local Ollama models too
- jnsahaj/lumen - Beautiful git diff viewer, generate commits with AI, get summary of changes, all from the CLI
- zurawiki/gptcommit - A git prepare-commit-msg hook for authoring commit messages with LLMs.
Web
Frontend and UI Components
- CopilotKit/CopilotKit - The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol
- Chainlit/chainlit - Build Conversational AI in minutes ⚡️
- thesysdev/openui - The Open Standard for Generative UI
- grab/cursor-talk-to-figma-mcp - TalkToFigma: MCP integration between AI Agent (Cursor, Claude Code, Codex) and Figma, allowing Agentic AI to communicate with Figma for reading designs and modifying them programmatically.
- neomjs/neo - Neo.mjs is a self-evolving software organism: a professional end-to-end AI engineering team whose cross-model swarm inhabits live apps via Neural Link, Active Hybrid GraphRAG, DreamService, and self-healing loops.
- CommandCodeAI/langui - UI for your AI. Open Source Tailwind components tailored for your GPT, generative AI, and LLM projects.
- Simon-He95/markstream-vue - Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, stream-diffs code blocks, safe HTML, and low-jitter updates.
- Jpisnice/shadcn-ui-mcp-server - A mcp server to allow LLMS gain context about shadcn ui component structure,usage and installation,compaitable with react,svelte 5,vue & React Native
- lobehub/lobe-icons - 🥨 Lobe Icons - Brings AI/LLM brand logos to your React & React Native apps — static SVG/PNG/WebP, no dependencies.
Scraping and Crawling
- firecrawl/firecrawl - The web data API to search, scrape, and interact at scale. 🔥
- browser-use/browser-use - Agents that use the browser.
- unclecode/crawl4ai - 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
- ScrapeGraphAI/Scrapegraph-ai - Python scraper based on AI
- apify/crawlee - Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
- Skyvern-AI/skyvern - Automate browser based workflows with AI
- browser-use/browser-harness - Browser Harness | Self-healing harness that enables LLMs to complete any task.
- nanobrowser/nanobrowser - Open-Source Chrome extension for AI-powered web automation. Run multi-agent workflows using your own LLM API key. Alternative to OpenAI Operator.
- jina-ai/reader - Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
- apify/crawlee-python - Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
- steel-dev/steel-browser - 🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.
- firecrawl/firecrawl-mcp-server - 🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
- mishushakov/llm-scraper - Turn any webpage into structured data using LLMs
- adbar/trafilatura - Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
- any4ai/AnyCrawl - AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
- browserbase/mcp-server-browserbase - Allow LLMs to control a browser with Browserbase and Stagehand (archived)
- oxylabs/oxylabs-ai-studio-py - Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering. (archived)
- itsOwen/CyberScraper-2077 - A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
- keon/browser-control - A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.
- spider-rs/spider - Foundational low latency web data collecting in Rust
- brightdata/brightdata-mcp - A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
- lmnr-ai/index - The SOTA Open-Source Browser Agent for autonomously performing complex tasks on the web (archived)
Data and Storage
Databases
- milvus-io/milvus - Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
- activeloopai/deeplake - Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
- postgresml/postgresml - Postgres with GPUs for ML/AI apps.
- FalkorDB/FalkorDB - A super fast Graph Database uses GraphBLAS under the hood for its sparse adjacency matrix graph representation. Our goal is to provide the best Knowledge Graph for LLM (GraphRAG).
- timescale/pgai - A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL (archived)
- infiniflow/infinity - The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.
- spiceai/spiceai - Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
- supabase-community/database-build - In-browser Postgres sandbox with AI assistance (formerly postgres.new)
- georgia-tech-db/evadb - Database system for AI-powered apps (archived)
- openlake-project/openlake - OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
- lealone/Lealone - 能安全适用于氛围编程和企业应用的全栈自进化通用智能体
Serialization and Formats
- toon-format/toon - 🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
- The-Vibe-Company/megaparse - File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.
- mangiucugna/json_repair - Repair malformed JSON from LLMs, APIs, logs, and user input in Python.
- haris-musa/excel-mcp-server - A Model Context Protocol server for Excel file manipulation
- AnswerDotAI/llms-txt - The /llms.txt file, helping language models use your website
Machine Learning and AI
LLM and Inference
- ollama/ollama - Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
- f/prompts.chat - f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-host for your organization with complete privacy.
- ggml-org/llama.cpp - LLM inference in C/C++
- vllm-project/vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
- infiniflow/ragflow - RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
- nomic-ai/gpt4all - GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
- unslothai/unsloth - Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
- hiyouga/LlamaFactory - Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
- BerriAI/litellm - The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- run-llama/llama_index - LlamaIndex is the document processing platform for AI
- mudler/LocalAI - LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
- QuantumNous/new-api - A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for personal and enterprise model management.
- microsoft/BitNet - Official inference framework for 1-bit LLMs
- HKUDS/LightRAG - [EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation
- The-Vibe-Company/quivr - Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.
- songquanpeng/one-api - LLM API 管理 & 分发系统,支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 适配,可用于 key 管理与二次分发。单可执行文件,提供 Docker 镜像,一键部署,开箱即用。LLM API management & key redistribution system, unifying multiple providers under a single API. Single binary, Docker-ready, with an English UI.
- AlexsJones/llmfit - Hundreds of models & providers. One command to find what runs on your hardware.
- sgl-project/sglang - SGLang is a high-performance serving framework for large language models and multimodal models.
- microsoft/graphrag - A modular graph-based Retrieval-Augmented Generation (RAG) system
- VectifyAI/PageIndex - 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
- linshenkx/prompt-optimizer - An AI prompt optimizer for writing better prompts and getting better AI results.
- lyogavin/airllm - AirLLM 70B inference with single 4GB GPU
- p-e-w/heretic - Fully automatic censorship removal for language models
- decolua/9router - Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
- tashfeenahmed/freellmapi - 7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.
- Tencent/WeKnora - Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
- mozilla-ai/llamafile - Distribute and run LLMs with a single file.
- mlc-ai/mlc-llm - Universal LLM Deployment Engine with ML Compilation
- jundot/omlx - LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
- QwenLM/Qwen - The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
- huggingface/peft - 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
- kvcache-ai/ktransformers - A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
- mlc-ai/web-llm - High-performance In-browser LLM Inference Engine
- ymcui/Chinese-LLaMA-Alpaca - 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
- xming521/WeClone - 🚀 One-stop solution for creating your AI twin from chat history 💡 Fine-tune LLMs with your chat logs to capture your unique style, then bind to a chatbot to bring your digital self to life.
- deepseek-ai/Janus - Janus-Series: Unified Multimodal Understanding and Generation Models
- modelscope/ms-swift - Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
- zai-org/ChatGLM2-6B - ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
- GeeeekExplorer/nano-vllm - Nano vLLM
- lidge-jun/opencodex - Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
- llmware-ai/llmware - Unified framework for building enterprise RAG pipelines with small, specialized models
- LlamaChinese/Llama-Chinese - Llama中文社区,实时汇总最新Llama学习资料,构建最好的中文Llama大模型开源生态,完全开源可商用
- BlinkDL/RWKV-LM - RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
- NVIDIA/TensorRT-LLM - TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
- 567-labs/instructor - structured outputs for llms
- Lightning-AI/litgpt - 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
- zai-org/ChatGLM3 - ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型
- Portkey-AI/gateway - A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- cocktailpeanut/dalai - The simplest way to run LLaMA on your local machine
- bentoml/OpenLLM - Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- simonw/llm - Access large language models from the command-line
- axolotl-ai-cloud/axolotl - Go ahead and axolotl questions
- LMCache/LMCache - LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
- cactus-compute/needle - Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
- microsoft/promptflow - Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
- OpenBMB/MiniCPM - MiniCPM5: SOTA on-device LLMs, small yet powerful.
- artidoro/qlora - QLoRA: Efficient Finetuning of Quantized LLMs
- mistralai/mistral-inference - Official inference library for Mistral models (archived)
- bigscience-workshop/petals - 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
- RunanywhereAI/runanywhere-sdks - Production ready toolkit to run AI locally
- Tiiny-AI/PowerInfer - High-speed Large Language Model Serving for Local Deployment
- xorbitsai/inference - Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
- nlpxucan/WizardLM - LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
- oumi-ai/oumi - Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!
- FMInference/FlexLLMGen - Running large language models on a single GPU for throughput-oriented scenarios. (archived)
- coaidev/coai - 🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.
- bentoml/BentoML - The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
- intel/ipex-llm - Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc. (archived)
- microsoft/TypeChat - TypeChat is a library that makes it easy to build natural language interfaces using types.
- THUDM/slime - slime is an LLM post-training framework for RL Scaling.
- bitsandbytes-foundation/bitsandbytes - Accessible large language models via k-bit quantization for PyTorch.
- qualcomm/GenieX - Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
- maximhq/bifrost - Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
- InternLM/lmdeploy - LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
- FareedKhan-dev/kimi-k3-in-c - A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
- PaddlePaddle/ERNIE - The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
- EricLBuehler/mistral.rs - Fast, flexible LLM inference
- guardrails-ai/guardrails - Adding guardrails to large language models.
- arcee-ai/mergekit - Tools for merging pretrained large language models.
- InternLM/InternLM - Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
- mit-han-lab/streaming-llm - [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
- deepseek-ai/DeepSeek-LLM - DeepSeek LLM: Let there be answers
- zai-org/GLM-5 - GLM-5: From Vibe Coding to Agentic Engineering
- NVIDIA-NeMo/Guardrails - NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
- ymcui/Chinese-LLaMA-Alpaca-2 - 中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
- ml-explore/mlx-lm - Run LLMs with MLX
- katanemo/plano - Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
- tbphp/gpt-load - Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
- MakazhanAlpamys/Soup - Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- drumih/turbo-fieldfare - Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
- microsoft/LLMLingua - [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
- yangjianxin1/Firefly - Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
- linkedin/Liger-Kernel - Efficient Triton Kernels for LLM Training
- kvcache-ai/Mooncake - Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
- BlockRunAI/ClawRouter - The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.
- flashinfer-ai/flashinfer - FlashInfer: Kernel Library for LLM Serving
- Arthur-Ficial/apfel - The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
- rustformers/llm - [Unmaintained, see README] An ecosystem of Rust libraries for working with large language models (archived)
- princeton-nlp/tree-of-thought-llm - [NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models
- cactus-compute/cactus - Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.
- vllm-project/semantic-router - A programmable Mixture-of-Models router for heterogeneous LLM inference
- rllm-org/rllm - Democratizing Reinforcement Learning for LLMs
- areal-project/AReaL - The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.
- lemonade-sdk/lemonade - Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
- google-deepmind/gemma - Gemma open-weight LLM library, from Google DeepMind
- gpustack/gpustack - A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
- huggingface/alignment-handbook - Robust recipes to align language models with human and AI preferences
- Blaizzy/mlx-vlm - MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
- lm-sys/RouteLLM - A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
- PeterGriffinJin/Search-R1 - Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL
- winfunc/deepreasoning - A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
- looplj/axonhub - ⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.
- InternLM/xtuner - A Next-Generation Training Engine Built for Ultra-Large MoE Models
- h2oai/h2o-llmstudio - H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
- salesforce/CodeGen - CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
- hiyouga/EasyR1 - EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
- AutoGPTQ/AutoGPTQ - An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm. (archived)
- microsoft/poml - Prompt Orchestration Markup Language
- facebookresearch/lingua - Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
- promptslab/Promptify - Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
- turboderp-org/exllamav2 - A fast inference library for running LLMs locally on modern consumer-class GPUs
- llm-d/llm-d - Achieve state of the art inference performance with modern accelerators on Kubernetes
- fixie-ai/ultravox - A fast multimodal LLM for real-time voice
- microsoft/LMOps - General technology for enabling AI capabilities w/ LLMs and MLLMs
- mosaicml/llm-foundry - LLM training code for Databricks foundation models
- zai-org/GLM-4.5 - GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models
- crmne/ruby_llm - The Ruby-native AI framework. Chats, agents, tools, images, audio, and video through one consistent API, in plain Ruby or Rails.
- Instruction-Tuning-with-GPT-4/GPT-4-LLM - Instruction Tuning with GPT-4
- algorithmicsuperintelligence/optillm - Optimizing inference proxy for LLMs
- ModelTC/LightLLM - LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
- SylphAI-Inc/AdalFlow - AdalFlow: The library to build & auto-optimize LLM applications.
- mshumer/gpt-llm-trainer
- OpenManus/OpenManus-RL - A live stream development of RL tunning for LLM agents
- OpenCSGs/csghub - CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! ⭐️
- defog-ai/sqlcoder - SoTA LLM for converting natural language questions to SQL queries
- QwenLM/Qwen3-Omni - Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, images, and video, as well as generating speech in real time.
- predibase/lorax - Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
- SciSharp/LLamaSharp - A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
- raullenchai/Rapid-MLX - The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
- PaddlePaddle/FastDeploy - High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
- NExT-GPT/NExT-GPT - Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
- pytorch/torchchat - Run PyTorch LLMs locally on servers, desktop and mobile (archived)
- LC1332/Luotuo-Chinese-LLM - 骆驼(Luotuo): Open Sourced Chinese Language Models. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技
- zhaoyingjun/chatbot - Chatbot继续沿着LLM前进,近期更新小参数量SLM的和训练脚本,支持本地训练。新增ChatAgent,实现各种有实际场景价值的Agent实现。
- HanaokaYuzu/Gemini-API - ✨ Reverse-engineered Python API for Google Gemini web app
- MiniMax-AI/MiniMax-01 - The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention
- arman-bd/guppylm - A ~9M parameter LLM that talks like a small fish.
- superlinked/sie - Open-source inference server and production cluster for all the models your agent needs.
- MiniMax-AI/MiniMax-M1 - MiniMax-M1, the world's first open-weight, large-scale hybrid-attention reasoning model.
- tekaratzas/RustGPT - An transformer based LLM. Written completely in Rust
- NVIDIA-NeMo/Switchyard - Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
- TanStack/ai - 🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.
- ridgerchu/matmulfreellm - Implementation for MatMul-free LM.
- salesforce/CodeT5 - Home of CodeT5: Open Code LLMs for Code Understanding and Generation (archived)
- b4rtaz/distributed-llama - Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
- containers/ramalama - RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
- dwgx/WindsurfAPI - Turn Windsurf / Devin Desktop's 100+ AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GLM, SWE) into OpenAI-, Anthropic- & Gemini-compatible APIs. Zero-dependency self-hosted reverse proxy for Claude Code, Cline & Cursor. 把 Windsurf/Devin 云端 100+ 模型变成三套兼容 API。
- thu-pacman/chitu - High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
- signerless/llm-checker - Advanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.
- michaelfeil/infinity - Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
- FreedomIntelligence/LLMZoo - ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡
- ax-llm/ax - The pretty much "official" DSPy framework for Typescript
- zjunlp/EasyEdit - [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
- ulab-uiuc/LLMRouter - LLMRouter: An Open-Source Library for LLM Routing
- Luce-Org/lucebox - LLM speculative inference server for heterogeneous hardware & consumer GPUs
- vllm-project/vllm-ascend - Community maintained hardware plugin for vLLM on Ascend
- spcl/graph-of-thoughts - Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
- OpenPipe/OpenPipe - Turn expensive prompts into cheap fine-tuned models
- mll-lab-nu/RAGEN - Agent RL framework for LLM agents: multi-turn reinforcement learning with StarPO and reasoning-collapse diagnostics
- Alpha-VLLM/LLaMA2-Accessory - An Open-source Toolkit for LLM Development
- wenge-research/YAYI2 - YAYI 2 是中科闻歌研发的新一代开源大语言模型,采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2 Chinese LLMs) (archived)
- PhoebusSi/Alpaca-CoT - We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台,我们欢迎开源爱好者发起任何有意义的pr!
- FasterDecoding/Medusa - Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
- vava-nessa/free-coding-models - Find, benchmark and install in CLI 170+ FREE coding LLM models across 15+ providers in real time
- OpenDCAI/DataFlex - Data-centric LLM training with dynamic sample selection, domain mixture optimization, and example reweighting inside the LLaMA-Factory training loop.
- ZHZisZZ/dllm - dLLM: Simple Diffusion Language Modeling
- JIA-Lab-research/LongLoRA - Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
- stochasticai/xTuring - Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
- bestruirui/octopus - One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关
- MiniMax-AI/MiniMax-M2 - MiniMax-M2, a model built for Max coding & agentic workflows.
- wenge-research/YAYI - 雅意大模型:为客户打造安全可靠的专属大模型,基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型,由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM) (archived)
- young-geng/EasyLM - Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
- xusenlinzy/api-for-open-llm - Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口
- google/tunix - A Lightweight LLM Post-Training Library
- jackmpcollins/magentic - Seamlessly integrate LLMs as Python functions
- prism-php/prism - A unified interface for working with LLMs in Laravel
- AI-Hypercomputer/maxtext - A simple, performant, and scalable Jax LLM!
- Jittor/JittorLLMs - 计图大模型推理库,具有高性能、配置要求低、中文支持好、可移植等特点
- dvmazur/mixtral-offloading - Run Mixtral-8x7B models in Colab or consumer desktops
Machine Learning Frameworks
- huggingface/transformers - 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
- karpathy/llm.c - LLM training in simple, raw C/CUDA
- microsoft/unilm - Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
- microsoft/agent-lightning - The absolute trainer to light up AI agents.
- alibaba/MNN - MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
- ludwig-ai/ludwig - Low-code framework for building custom LLMs, neural networks, and other AI models
- gorse-io/gorse - AI powered open source recommender system engine supports classical/LLM rankers and multimodal content via embedding
- nebuly-ai/optimate - A collection of libraries to optimise AI model performances
- haifengl/smile - Statistical Machine Intelligence & Learning Engine
- amazon-science/chronos-forecasting - Chronos: Pretrained Models for Time Series Forecasting
- higgsfield-ai/higgsfield - Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
- SwanHubX/SwanLab - ⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
- Nixtla/nixtla - TimeGPT-2.1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection. Generative pretrained transformer for time series trained on over 100B data points. It's capable of accurately predicting various domains such as retail, electricity, finance, and IoT with just a few lines of code 🚀.
- fnnx-ai/scikit-llm - Seamlessly integrate LLMs into scikit-learn.
- towhee-io/towhee - Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
- alpa-projects/alpa - Training and serving large-scale neural networks with auto parallelization. (archived)
- microsoft/torchscale - Foundation Architecture for (M)LLMs
- KimMeen/Time-LLM - [ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"
- ailia-ai/ailia-models - The collection of pre-trained, state-of-the-art AI models for ailia SDK
Computer Vision
- PaddlePaddle/PaddleOCR - Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
- opendatalab/MinerU - Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
- allenai/olmocr - Toolkit for linearizing PDFs for LLM datasets/training
- zai-org/CogVideo - text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)
- OpenGVLab/InternVL - [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
- om-ai-lab/VLM-R1 - Solve Visual Understanding with Reinforced VLMs
- joanrod/star-vector - StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textual inputs to produce high-quality SVG code with remarkable precision.
- lumina-ai-inc/chunkr - Vision infrastructure to turn complex documents into RAG/LLM-ready data
- NVlabs/Eagle - Eagle: Frontier Vision-Language Models with Data-Centric Strategies
- OpenGVLab/InternGPT - InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
- CatchTheTornado/text-extract-api - Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown
- SkyworkAI/Skywork-R1V - Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in vision-language reasoning.
- Filimoa/open-parse - Improved file parsing for LLM’s
- SharpAI/DeepCamera - Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.
- Dicklesworthstone/llm_aided_ocr - Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs
- sherlockchou86/VideoPipe - A cross-platform video structuring (video analysis) framework based on CV models & mLLM.
- InternLM/InternLM-XComposer - InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
- JIA-Lab-research/LISA - Project Page for "LISA: Reasoning Segmentation via Large Language Model"
Natural Language Processing
- 2noise/ChatTTS - A generative speech model for daily dialogue.
- google/langextract - A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
- PaddlePaddle/PaddleNLP - Easy-to-use and powerful LLM and SLM library with awesome model zoo.
- FlagOpen/FlagEmbedding - Retrieval and Retrieval-augmented LLMs
- karpathy/minbpe - Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
- fishaudio/Bert-VITS2 - vits2 backbone with multilingual-bert
- canopyai/Orpheus-TTS - Towards Human-Sounding Speech
- huggingface/text-embeddings-inference - A blazing fast inference solution for text embeddings models
- SakuraLLM/SakuraLLM - 适配轻小说/Galgame的日中翻译大模型
- JohnSnowLabs/spark-nlp - State of the Art Natural Language Processing
- OpenMOSS/MOSS-TTS - An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS
- marcelroed/gigatoken - Language model tokenization at GB/s
- yifanfeng97/Hyper-Extract - Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal extractions — with one command.
- dongrixinyu/JioNLP - 中文 NLP 预处理、解析工具包,准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com
- robert-mcdermott/ai-knowledge-graph - AI Powered Knowledge Graph Generator
- hydropix/TranslateBooksWithLLMs - Translate full-length books and documents with Ollama, OpenAI-compatible, Gemini, Mistral, DeepSeek, Poe or OpenRouter. Preserves formatting. Resumes where you left off. No file size limits.
Data Science and Analytics
- pathwaycom/pathway - Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
- vanna-ai/vanna - 🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval 🔄. (archived)
- sinaptik-ai/pandas-ai - Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
- huggingface/datasets - 🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
- eosphoros-ai/DB-GPT - open-source agentic AI data assistant for the next generation of AI + Data products.
- Canner/WrenAI - GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.
- Unstructured-IO/unstructured - Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.
- ConardLi/easy-dataset - A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
- cocoindex-io/cocoindex - Incremental engine for long horizon agents 🌟 Star if you like it!
- Netflix/metaflow - Build, Manage and Deploy AI/ML Systems
- apache/seatunnel - SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
- OpenDCAI/DataFlow - [SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.
- flyteorg/flyte - Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.
- Zipstack/unstract - LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
- datajuicer/data-juicer - Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
- dataease/SQLBot - 🔥 基于大模型和 RAG 的智能问数系统,对话式数据分析神器。Text-to-SQL Generation via LLMs using RAG.
- zenml-io/zenml - ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
- ChenLiu-1996/figures4papers - My Python scripts to make high-quality figures for publications in top AI conferences and journals.
- katanaml/sparrow - Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM
- argilla-io/argilla - Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
- tencentmusic/supersonic - SuperSonic is the next-generation AI+BI platform that unifies Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.
- ruc-datalab/DeepAnalyze - DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师,自动分析大量数据,一键生成专业分析报告!
- antvis/mcp-server-chart - 🤖 A visualization mcp & skills contains 25+ visual charts using @antvis. Using for chart generation and data analysis.
- StructuredLabs/preswald - Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable completely in-browser, using Pyodide, DuckDB, Pandas, and Plotly, Matplotlib, etc. Build dashboards, reports, and notebooks that run offline, load fast, and share like a document.
- ucbepic/docetl - A system for agentic LLM-powered data processing and ETL
- microsoft/lida - Automatic Generation of Visualizations and Infographics using Large Language Models
- Zafer-Liu/Data-Analysis-Agent - 🚀你的私人数据分析助手。通过对话式交互,自动生成可视化报表与商业洞察,让数据决策变得像聊天一样简单。 🚀 Your personal data analysis assistant. Say goodbye to complex SQL and Excel formulas. An LLM-powered data analysis agent. Chat with your data to instantly generate visualizations and business insights. Making data-driven decisions has never been easier.
- pingcap/ossinsight - Analysis, Comparison, Trends, Rankings of Open Source Software, you can also get insight from more than 10 billion with natural language (powered by LLM). Follow us on Twitter: https://twitter.com/ossinsight
- hitsz-ids/synthetic-data-generator - SDG is a specialized framework designed to generate high-quality structured tabular data.
- DeepInsight-AI/DeepBI - LLM based data scientist, AI native data application. AI-driven infinite thinking redefines BI.
- refuel-ai/autolabel - Label, clean and enrich text datasets with LLMs.
AI Agents
Agent Frameworks and Runtimes
- NousResearch/hermes-agent - The agent that grows with you
- Significant-Gravitas/AutoGPT - AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
- langgenius/dify - Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.
- langchain-ai/langchain - The agent engineering platform.
- earendil-works/pi - AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
- OpenHands/OpenHands - 🙌 OpenHands: AI-Driven Development
- bytedance/deer-flow - An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
- FoundationAgents/MetaGPT - 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
- aaif-goose/goose - an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM
- zhayujie/CowAgent - Open-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-agent, multi-model, multi-channel. Lightweight, extensible, one-line install. (formerly chatgpt-on-wechat)
- langchain-ai/langgraph - Build resilient agents.
- AstrBotDevs/AstrBot - AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨
- tinyhumansai/openhuman - OpenHuman is an open source agent harness with local-first memory, agent orchestration, and workflows
- reworkd/AgentGPT - 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser. (archived)
- esengine/DeepSeek-Reasonix - DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.
- OpenBMB/ChatDev - ChatDev 2.0: Dev All through LLM-powered Multi-Agent Collaboration
- agentscope-ai/agentscope - Build and run agents you can see, understand and trust.
- can1357/oh-my-pi - ⌥ Coding agent with the IDE wired in
- stanford-oval/storm - An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.
- labring/FastGPT - FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.
- openai/openai-agents-python - A lightweight, powerful framework for multi-agent workflows
- assafelovic/gpt-researcher - An autonomous agent that conducts deep research on any data using any LLM providers
- microsoft/semantic-kernel - Integrate cutting-edge LLM technology quickly and easily into your apps
- mastra-ai/mastra - Mastra is the modern TypeScript framework for AI-powered applications and agents.
- QwenLM/qwen-code - An open-source AI coding agent that lives in your terminal.
- Fosowl/agenticSeek - Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity.
- vercel/ai - The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
- deepset-ai/haystack - Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
- microsoft/JARVIS - JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
- letta-ai/letta - Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.
- 1Panel-dev/MaxKB - 🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
- google/adk-python - An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
- SWE-agent/SWE-agent - SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
- kortix-ai/suna - The open-source AI Management System
- pydantic/pydantic-ai - How Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end.
- Alibaba-NLP/DeepResearch - Tongyi Deep Research, the Leading Open-source Deep Research Agent
- 1jehuang/jcode - The most RAM efficient harness
- emcie-co/parlant - Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.
- arc53/DocsGPT - Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
- RightNow-AI/openfang - Open-source Agent Operating System
- langbot-app/LangBot - Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Moonshot, openclaw / hermes agent, deerflow
- rowboatlabs/rowboat - AI coworker with memory and collaboration
- TransformerOptimus/SuperAGI - <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
- cft0808/edict - 🏛️ 三省六部制 · OpenClaw Multi-Agent Orchestration System — 9 specialized AI agents with real-time dashboard, model config, and full audit trails
- plandex-ai/plandex - Open source AI coding agent. Designed for large projects and real world tasks.
- botpress/botpress - The open-source hub to build & deploy GPT/LLM Agents ⚡️
- microsoft/RD-Agent - Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through R&D-Agent, which lets AI drive data-driven AI. 🔗https://aka.ms/RD-Agent-Tech-Report
- e2b-dev/E2B - Open-source, secure environment with real-world tools for enterprise-grade agents.
- opencode-ai/opencode - A powerful AI coding agent. Built for the terminal. (archived)
- langchain4j/langchain4j - LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
- cloudwego/eino - The ultimate LLM/AI application development framework in Go.
- bytedance/trae-agent - Trae Agent is an LLM-based agent for general purpose software engineering tasks.
- dataelement/bisheng - BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
- humanlayer/humanlayer - The best way to get AI coding agents to solve hard problems in complex codebases.
- holaboss-ai/holaOS - Open-source agentic workspace enterprises can make their own. Connect the systems you already run — 100+ integrations, MCP, chat tools, apps, browser, local files — with shared memory. Any agent (Claude Code, Codex), any model, or BYOK. Set up in clicks, not months. Local-first: your data never leaves your machines.
- The-Pocket/PocketFlow - Pocket Flow: 100-line LLM framework. Let Agents build Agents!
- bytebot-ai/bytebot - Bytebot is a self-hosted AI desktop agent that automates computer tasks through natural language commands, operating within a containerized Linux desktop environment. (archived)
- langchain-ai/open-swe - An Open-Source Asynchronous Coding Agent
- VoltAgent/voltagent - AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework
- astrid-runtime/astrid - Astrid is a portable, capability-secure operating system for composable software.
- omnigent-ai/omnigent - Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.
- HKUDS/AutoAgent - "AutoAgent: Fully-Automated and Zero-Code LLM Agent Framework"
- microsoft/UFO - UFO³: Weaving the Digital Agent Galaxy
- tmc/langchaingo - LangChain for Go, the easiest way to write LLM-based programs in Go
- droidrun/mobilerun - Automate your mobile devices with natural language commands - an LLM agnostic mobile Agent 🤖
- MervinPraison/PraisonAI - PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.
- iflytek/astron-agent - Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
- google/adk-go - An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
- 0xPlaygrounds/rig - ⚙️🦀 Build modular and scalable LLM Applications in Rust
- lastmile-ai/mcp-agent - Build effective agents using Model Context Protocol and simple workflow patterns
- OpenBMB/XAgent - An Autonomous LLM Agent for Complex Task Solving
- rocketride-org/rocketride-server - High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.
- zilliztech/deep-searcher - Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
- osaurus-ai/osaurus - Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.
- microsoft/TinyTroupe - LLM-powered multiagent persona simulation for imagination enhancement and business insights.
- strands-agents/harness-sdk - Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.
- open-multi-agent/open-multi-agent - Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.
- InternLM/MindSearch - 🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
- TencentQQGYLab/AppAgent - AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.
- julep-ai/julep - Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.
- genkit-ai/genkit - Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
- lavague-ai/LaVague - Large Action Model framework to develop AI Web Agents
- PrefectHQ/marvin - an ambient intelligence library
- microsoft/TaskWeaver - The first "code-first" agent framework for seamlessly planning and executing data analytics tasks. (archived)
- kuafuai/DevOpsGPT - Multi agent system for AI-driven software development. Combine LLM with DevOps tools to convert natural language requirements into working software. Supports any development language and extends the existing code.
- aiwaves-cn/agents - An Open-source Framework for Data-centric, Self-evolving Autonomous Language Agents
- fengshao1227/ccg-workflow - 多模型协作工作流引擎 — /ccg:go 一个命令,AI 自动分析意图、选择策略、编排 Codex + Gemini + Claude 协作执行
- ModelEngine-Group/nexent - Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skills, memory, and orchestration with built-in constraints, feedback loops, and control planes.
- truefoundry/trueforge - The open-source agent harness - the runtime layer that turns an LLM into a working agent.
- PySpur-Dev/pyspur - A visual playground for agentic workflows: Iterate over your agents 10x faster
- generalaction/emdash - Emdash is the Open-Source Agentic Development Environment (🧡 YC W26). Run multiple coding agents in parallel. Use any provider.
- ageerle/ruoyi-ai - An enterprise AI development framework for building AI agents. It provides unified management of multi-provider LLMs, secure enterprise knowledge bases with high-precision retrieval, visual workflow orchestration and multi-agent coordination. Compatible with mainstream Agent Skill standards, it enables developers to efficiently build production-gra
- agentscope-ai/agentscope-java - Build distributed, production-grade, long-running agents.
- dograh-hq/dograh - Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.
- the-open-agent/openagent - ⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org
- apache/maka - Apache Maka (Incubating) is a high-performance agent workspace that keeps a complete record of everything it did.
- TaskingAI/TaskingAI - The open source platform for AI-native application development.
- OpenBMB/AgentVerse - 🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation
- ag2ai/ag2 - AG2 (formerly AutoGen): The Open-Source AgentOS.Join us at: https://discord.gg/sNGSwQME3x
- xlang-ai/OpenAgents - [COLM 2024] OpenAgents: An Open Platform for Language Agents in the Wild
- Integuru-AI/Integuru - The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs.
- spinabot/brigade - Brigade — Your personal intelligence, built enterprise-grade
- Ironclad/rivet - The open-source visual AI programming environment and TypeScript library
- rivet-dev/agentos - Give agents an operating system as a library. Runs in your existing backend – no sandboxes, VMs, or SaaS. Powered by WebAssembly & V8 isolates.
- JetBrains/koog - Koog is a JVM (Java and Kotlin) framework for building predictable, fault-tolerant and enterprise-ready AI agents across all platforms – from backend services to Android and iOS, JVM, and even in-browser environments. Koog is based on our AI products expertise and provides proven solutions for complex LLM and AI problems
- gptme/gptme - Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
- ysymyth/ReAct - [ICLR 2023] ReAct: Synergizing Reasoning and Acting in Language Models
- dataelement/Clawith - Your First AI Agents Company
- openagents-org/openagents - OpenAgents - The collaboration OS for AI agents
- langroid/langroid - Harness LLMs with Multi-Agent Programming
- kirodotdev/KiroCrew - A persistent workspace for development work that self-improves and continues beyond one session.
- lemony-ai/cascadeflow - Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.
- EverMind-AI/Raven - The Harness of Harnesses: a trusted, persistent, self-evolving multi-agent ecosystem for all-domain collaboration.
- LazyAGI/LazyLLM - Easiest and laziest way for building multi-agent LLMs applications.
- Atmosphere/atmosphere - Portable AI agent runtime for the JVM. One @Agent class runs on Spring AI, LangChain4j, Anthropic, or 9 more behind one SPI. Token streaming, tool calls, human approvals, and governance over WebSocket, SSE, gRPC, or WebTransport/HTTP3. Speaks MCP, A2A, and AG-UI.
- vocodedev/vocode-core - 🤖 Build voice-based LLM agents. Modular + open source.
- nextlevelbuilder/goclaw - GoClaw - GoClaw is OpenClaw rebuilt in Go — with multi-tenant isolation, 5-layer security, and native concurrency. Deploy AI agent teams at scale without compromising on safety.
- aiming-lab/MetaClaw - 🦞 Just talk to your agent — it learns and EVOLVES 🧬.
- i-am-bee/beeai-framework - Build production-ready AI agents in both Python and Typescript.
- Intelligent-Internet/ii-agent - II-Agent: a new open-source framework to build and deploy intelligent agents
- fuxicodex/Fuxi - FuXi is a fast, self-contained AI coding agent that lives in your terminal — edit code, run commands, and drive tools, with cost-aware routing across LLM providers.
- langchain-ai/langgraphjs - Framework to build resilient language agents as graphs.
- noahshinn/reflexion - [NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning
- agent-of-empires/agent-of-empires - Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding.
- Josh-XT/AGiXT - AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
- cosmicstack-labs/mercury-agent - Soul-driven AI agent with permission-hardened tools, token budgets, and multi-channel access. Runs 24/7 from CLI, Telegram or More.
- cheshire-cat-ai/core - AI agent microservice
- run-llama/LlamaIndexTS - Data framework for your LLM applications. Focus on server side solution (archived)
- jjyaoao/HelloAgents - A agent framework based on the tutorial hello-agents
- MiniMax-AI/Mini-Agent - A minimal yet professional single agent demo project that showcases the core execution pipeline and production-grade features of agents.
- gmpetrov/databerry - The no-code platform for building custom LLM Agents
- moltis-org/moltis - A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on your hardware.
- wanikua/danghuangshang - Open-source multi-agent collaboration system inspired by Chinese governance — deploy and coordinate specialized AI agents with OpenClaw.
- wassim249/fastapi-langgraph-agent-production-ready-template - A production-ready FastAPI template for building AI agent applications with LangGraph integration. This template provides a robust foundation for building scalable, secure, and maintainable AI agent services.
- om-ai-lab/OmAgent - [EMNLP-2024] Build multimodal language agents for fast prototype and production
- itayinbarr/little-coder - A harness optimized to smaller LLMs
- BAAI-Agents/Cradle - The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.
- griptape-ai/griptape - Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
- Agent-Field/agentfield - Build, run and scale AI agents like API and microservices
- AtomicBot-ai/atomic-agent - Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
- Nano-Collective/nanocoder - An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.
- UnicomAI/wanwu - China Unicom's Yuanjing Wanwu Agent Platform is an enterprise-grade, multi-tenant AI agent development platform. It helps users build applications such as intelligent agents, workflows, and rag, and also supports model management. The platform features a developer-friendly license, and we welcome all developers to build upon the platform.
- paulpierre/RasaGPT - 💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram
- FullAgent/fulling - Fulling is an AI-powered Full-stack Engineer Agent. Built with Next.js, Claude, shadcn/ui, and PostgreSQL. Use kubernetes as infra.
- heshengtao/comfyui_LLM_party - LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, kimi,doubao. Adapted to local llms, vlm, gguf such as llama-3.3 Janus-Pro, Linkage graphRAG
- agentuniverse-ai/agentUniverse - agentUniverse is a LLM multi-agent framework that allows developers to easily build multi-agent applications.
- maitrix-org/llm-reasoners - A library for advanced large language model reasoning
- dot-agent/nextpy - 🤖Self-Modifying Framework from the Future 🔮 World's First AMS
- langchain-ai/langserve - LangServe 🦜️🏓 (archived)
Agent Skills and Tooling
- affaan-m/ECC - The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
- multica-ai/andrej-karpathy-skills - A single CLAU