← Latest products

Airgapped Offline RAG

Run LLMs Locally with Llama, Mistral, & Gemini. Secure, locally-run Retrieval-Augmented Generation system for document-based question-answering, utilizing Llama 3, Mistral, and Gemini models with a user-friendly Streamlit interface. I've built an airgapped Retrieval-Augmented Generation (RAG) system for question-answering on documents, running entirely offline with local inference.

Open source

87 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. An LLM-powered advanced RAG pipeline built from scratch

    Hacker News131 pts

  2. spot changes to LLM answers, using few tokens

    Hacker News11 pts

  3. Text-To-Speech, RAG, and LLMs. All local!

    Hacker News19 pts

  4. RAGless

    github.com

    similar to RAG, but $0 LLM API costs at runtime

    Hacker News6 pts

  5. RAGatouille

    github.com

    a simple lib to use&train top retrieval models in RAG apps

    Hacker News15 pts