Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

Local RAG

Offline, open-source retrieval augmented generation.

Ingest local files, GitHub repositories, and websites for retrieval augmented generation (RAG) with local Ollama models. Local RAG keeps chat, embeddings, and indexed source content on your machine or network.

Features:

Local Ollama chat models
Ollama or local Hugging Face embedding models
Multiple ingestion sources:
- Local files
- GitHub repositories
- Websites
Streaming RAG responses through LlamaIndex
Browser-local settings persistence
Chat history export
Upload, URL, repository, and ingestion guardrails

Learn More:

Setup & Deploy the App
Using Local RAG
RAG Pipeline
Planned Features
Troubleshooting
Known Bugs & Issues
Resources
Contributing
Security Policy
Changelog

local-rag

Local RAG