← Latest products

ChainFactory

Run Structured LLM Inference with Easy Parallelism. how does moving llm call prompts and output structure definitions away from code into configuration land sound?

Open source

18 stars · GitHubexternal siteArchived

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Speeding up LLM inference 2x times (possibly)

    asciinema.org

    Here's a project I've been working on for the last few months.

    Hacker News419 pts

  2. BonzAI

    bonzai.sh

    self-sovereign, local LLM inference in the browser

    Hacker News5 pts

  3. Distributed Llama

    github.com

    Run LLMs on multiple devices in parallel

    Hacker News12 pts

  4. Kairo

    github.com

    Fail-closed LLM inference routing from RTX 5090 measurements

    Hacker News5 pts

  5. Structured output from LLMs without reprompting

    automorphic.ai

    Built a tool for transforming unstructured data into structured outputs using language models (with 100% adherence).

    Hacker News174 pts