← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

ik_llama.cpp

github.com

llama.cpp fork with additional SOTA quants and improved performance

Open source

Visit github.comexternal siteGitHub3,381 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. LMQL becomes simpler and adds llama.cpp

    lmql.ailatest reaction

    Hacker News
    6 pts
    GitHub
    No reaction

  2. llamacoder

    Open source Claude Artifacts – built with Llama 3.1 405B

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    7,156 stars

  3. Llama2.ipynb

    Ipython notebook copy of Andrej Karpathy's llama2.c

    github.comOpen source2 reactionslatest reaction

    Hacker News
    12 pts
    GitHub
    23 stars

  4. wllama

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    github.comOpen sourcelatest reaction

    Hacker News
    No reaction
    GitHub
    1,363 stars

  5. A fully open-source (Apache 2.0)implementation of llama

    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    github.comOpen source2 reactionslatest reaction

    Hacker News
    158 pts
    GitHub
    6,083 stars