Prompts as WASM Programs
AICI: Prompts as (Wasm) Programs. AICI is a proposed common interface between LLM inference engines (llama.cpp, vLLM, HF Transformers, etc.) and "controllers" - programs that can constrain the LLM output according to regexp, grammar, or custom logic, as well as control the generation process (forking, backtracking, etc.).
Open source
Reactions (1)
Similar products
by description similarity
TutoriaLLM
github.comAI Integrated programming tutorials
lambdaprompt
github.combuild, compose and call templated LLM prompts
Prompt-Engineering Tool
github.comAI-to-AI Testing for LLM
PromptL
promptl.aia templating language designed for LLM prompting
InferX: Inference as a Service Platform