← Latest products

A fully open-source (Apache 2.0)implementation of llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed. We believe that AI should be fully open source and part of the collective knowledge.

Open source

6,083 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Llama Running on a Microcontroller

    github.com

    A "large" language model running on a microcontroller

    Hacker News49 pts

  2. Llama 3.2 Interpretability with Sparse Autoencoders

    github.com

    A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.

    Hacker News579 pts

  3. Reducing LLM input tokens by 70%

    adola.app

    Run GPT-OSS, Qwen, Llama, and DeepSeek through one OpenAI-compatible API with streaming and clear usage-based pricing.

    Hacker News56 pts

  4. AI Proxy with Support for OpenAI

    braintrustdata.com

    Anthropic, LLaMa2, Mistral

    Hacker News10 pts

  5. LLaVaVision

    github.com

    An AI "Be My Eyes"-like web app with a llama.cpp backend

    Hacker News154 pts