← 최신 프로덕트

Composable middleware for LLM inference Optimization Passes

A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents. Today I'm sharing a feature I haven't seen done well elsewhere: composable middleware layers for LLM inference pipelines.

라이브러리오픈소스

772 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점

  2. Offeryn

    github.com

    Build Tools for LLMs in Rust, with Model Context Protocol

    Hacker News7점

  3. An educational Local Qwen3 LLM Inference project written in Rust

    github.com

    An educational Rust project for exporting and running inference on Qwen3 LLM family

    Hacker News15점

  4. GraphFlow

    github.com

    A lightweight Rust framework for multi-agent orchestration

    Hacker News10점

  5. Agentpanel

    github.com

    Universal LLM API Written in Rust

    Hacker News9점