← 최신 프로덕트

ChainFactory

Run Structured LLM Inference with Easy Parallelism. how does moving llm call prompts and output structure definitions away from code into configuration land sound?

오픈소스

18 스타 · GitHub외부 사이트보관됨

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Speeding up LLM inference 2x times (possibly)

    asciinema.org

    Here's a project I've been working on for the last few months.

    Hacker News419점

  2. BonzAI

    bonzai.sh

    self-sovereign, local LLM inference in the browser

    Hacker News5점

  3. Distributed Llama

    github.com

    Run LLMs on multiple devices in parallel

    Hacker News12점

  4. Kairo

    github.com

    Fail-closed LLM inference routing from RTX 5090 measurements

    Hacker News5점

  5. Structured output from LLMs without reprompting

    automorphic.ai

    Built a tool for transforming unstructured data into structured outputs using language models (with 100% adherence).

    Hacker News174점