← Latest products

LlamaFarm (YC W22)

Open-source framework for distributed AI. Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes. We're Rob, Matt, and Rachel from LlamaFarm ( https://llamafarm.dev ).

LibraryOpen source

836 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158 pts

  2. instantly

    Hacker News7 pts

  3. Open Source LLM Gateway 🦚

    Hacker News102 pts

  4. Maitai (YC S24)

    trymaitai.ai

    Self-Optimizing LLM Platform

    Hacker News149 pts

  5. You can now build serverless AI inference web application with ggml.js's LM backends.

    Hacker News23 pts