← Latest products

Llama.go

port of llama.cpp to pure Go. llama.go is like llama.cpp in pure Golang! It's April 12 - The First Man in Space* Day - and I'm releasing #ML framework I've been building for the last month :) It's written in #Go and allows #LLaMA #GPT inference having just regular PC - so no monster GPU cluster is needed to start experiment with: https://github.com/gotzmann/llama.go The.

Open source

1,405 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Llama.cpp Tutorial 2026

    news.ycombinator.com

    Run GGUF Models Locally on CPU and GPU

    Hacker News13 pts

  2. Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU

    github.com

    High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.

    Hacker News395 pts

  3. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45 pts

  4. STT –> LLM –> TTS pipeline in C

    github.com

    Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.

    Hacker News11 pts

  5. Open-source load balancer for llama.cpp

    github.com

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Hacker News151 pts