← 최신 프로덕트

Llama.go

port of llama.cpp to pure Go. llama.go is like llama.cpp in pure Golang! It's April 12 - The First Man in Space* Day - and I'm releasing #ML framework I've been building for the last month :) It's written in #Go and allows #LLaMA #GPT inference having just regular PC - so no monster GPU cluster is needed to start experiment with: https://github.com/gotzmann/llama.go The.

오픈소스

1,405 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Llama.cpp Tutorial 2026

    news.ycombinator.com

    Run GGUF Models Locally on CPU and GPU

    Hacker News13점

  2. Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU

    github.com

    High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.

    Hacker News395점

  3. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점

  4. STT –> LLM –> TTS pipeline in C

    github.com

    Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.

    Hacker News11점

  5. Open-source load balancer for llama.cpp

    github.com

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Hacker News151점