← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

Llama-2-Open-Source-LLM-CPU-Inference

github.com

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

Open source

Visit github.comexternal siteGitHub971 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. ZhiLight

    A highly optimized LLM inference acceleration engine for Llama and its variants.

    GitHub906 starsgithub.comOpen sourcelatest reaction

  2. wllama

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    GitHub1,375 starsgithub.comOpen sourcelatest reaction

  3. LLM

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45 ptsGitHub6,145 starsgithub.comCLIOpen source2 reactionslatest reaction

  4. T-MAC

    Low-bit LLM inference on CPU/NPU with lookup table

    Hacker News5 ptsGitHub1,005 starsgithub.comOpen source2 reactionslatest reaction

  5. dotLLM

    LLM inference engine written in .NET

    GitHub528 starsgithub.comOpen sourcelatest reaction