← Latest products

STT –> LLM –> TTS pipeline in C

Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible. For speech-to-text, large-language-model inference and text-to-speech I created three wrapper libraries in C/C++ (using Whisper.cpp, Llama.cpp and Piper).

LibraryOpen source

15 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45 pts

  2. Grammar Generator App for Llama.cpp

    grammar.intrinsiclabs.ai

    llama.cpp added context-free grammar guided generation functionality.

    Hacker News19 pts

  3. Minute

    github.com

    Offline meeting notes on macOS with Whisper and llama.cpp

    Hacker News12 pts

  4. Llama.go

    github.com

    port of llama.cpp to pure Go

    Hacker News25 pts

  5. Open-source load balancer for llama.cpp

    github.com

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Hacker News151 pts