← Latest products

Aqueduct

The easiest way to run open source LLMs. Herald detects potential issues, investigates them across code, infrastructure, and telemetry, and hands you the root cause. Aqueduct's LLM support makes it easy for you to run open-source LLMs on any infrastructure that you use.

Visit aqueducthq.comexternal site

Reactions (1)

Similar products

by description similarity

  1. I built an open-source answer engine that runs local LLMs

    github.com

    🔍 AI search engine - self-host with local or cloud LLMs

    Hacker News5 pts

  2. LLM CLI tool now supports self-hosted language models via plugins

    simonwillison.net

    LLM is my command-line utility and Python library for working with large language models such as GPT-4. I just released version 0.5 with a huge new feature: you can now …

    Hacker News6 pts

  3. Self-host open-source LLMs on AWS with scale-to-zero

    github.com

    Deploy LLMs to production in one command. Puffdeploy CLI is an open-source engine that provisions optimized serverless infrastructure directly in your own AWS/GCP account.

    Hacker News7 pts

  4. liteLLM

    litellm.ai

    One library to standardize all LLM APIs

    Hacker News140 ptsProduct Hunt121 votes

  5. I built a backend so simple that it fits in a YAML file

    manifest.build

    Open Source LLM Gateway 🦚

    Hacker News102 pts