← Latest products

app for interaction with documents using local LLM (mini Chat With RTX)

Text-To-Speech, RAG, and LLMs. All local! I wanted to share a side project of mine: a fully standalone app that uses a local LLM (specifically Mistral 7B) for document interaction using RAG.

Self-hostedOpen source

1,916 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. LLM App

    github.com

    build a realtime LLM app in 30 lines, with no vector database

    Hacker News11 pts

  2. Local LLM Notepad

    github.com

    run a GPT-style model from a USB stick

    Hacker News40 pts

  3. Local note engine uses LLM to organize notes into a knowledge graph

    github.com

    Local note engine that uses LLM to build and evolve a knowledge graph

    Hacker News11 pts

  4. NotesOllama

    smallest.app

    I added local LLM support to Apple Notes (through Ollama)

    Hacker News156 pts

  5. AnyLM

    anylm.app

    ChatGPT-Like UI for Local LLMs

    Hacker News13 pts