← 최신 프로덕트

Prompts as WASM Programs

AICI: Prompts as (Wasm) Programs. AICI is a proposed common interface between LLM inference engines (llama.cpp, vLLM, HF Transformers, etc.) and "controllers" - programs that can constrain the LLM output according to regexp, grammar, or custom logic, as well as control the generation process (forking, backtracking, etc.).

오픈소스

2,074 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. TutoriaLLM

    github.com

    AI Integrated programming tutorials

    Hacker News128점

  2. lambdaprompt

    github.com

    build, compose and call templated LLM prompts

    Hacker News9점

  3. Prompt-Engineering Tool

    github.com

    AI-to-AI Testing for LLM

    Hacker News37점

  4. PromptL

    promptl.ai

    a templating language designed for LLM prompting

    Hacker News7점

  5. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    github.com

    InferX: Inference as a Service Platform

    Hacker News5점