LlamaFarm (YC W22)
Open-source framework for distributed AI. Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes. We're Rob, Matt, and Rachel from LlamaFarm ( https://llamafarm.dev ).
LibraryOpen source
Reactions (1)
Similar products
by description similarity
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Run any Llama model finetune and more
featherless.aiinstantly
I built a backend so simple that it fits in a YAML file
manifest.buildOpen Source LLM Gateway 🦚
Maitai (YC S24)
trymaitai.aiSelf-Optimizing LLM Platform
Run LLaMa2 on the Browser with Ggml.js
rahuldshetty.github.ioYou can now build serverless AI inference web application with ggml.js's LM backends.