← 최신 프로덕트

STT –> LLM –> TTS pipeline in C

Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible. For speech-to-text, large-language-model inference and text-to-speech I created three wrapper libraries in C/C++ (using Whisper.cpp, Llama.cpp and Piper).

라이브러리오픈소스

15 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점

  2. Grammar Generator App for Llama.cpp

    grammar.intrinsiclabs.ai

    llama.cpp added context-free grammar guided generation functionality.

    Hacker News19점

  3. Minute

    github.com

    Offline meeting notes on macOS with Whisper and llama.cpp

    Hacker News12점

  4. Llama.go

    github.com

    port of llama.cpp to pure Go

    Hacker News25점

  5. Open-source load balancer for llama.cpp

    github.com

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Hacker News151점