← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

LightLLM

github.com

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

LibraryOpen source

Visit github.comexternal siteGitHub4,358 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. recursive-llm

    Recursive Language Models for efficient long-context processing. Analyze 1M+ tokens by storing context in a Python REPL while reducing LLM token usage.

    GitHub615 starsgithub.comOpen sourcelatest reaction

  2. LiteRT-LM

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    Hacker News5 ptsGitHub6,844 starsgithub.comLibraryOpen source2 reactionslatest reaction

  3. rank_llm

    RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.

    GitHub684 starsgithub.comOpen sourcelatest reaction

  4. liteLLM

    One library to standardize all LLM APIs

    Hacker News938 ptsProduct Hunt121 votesGitHub62,959 starslitellm.aiLibraryOpen source11 reactionslatest reaction

  5. I built a tiny LLM to demystify how language models work

    A ~9M parameter LLM that talks like a small fish.

    Hacker News915 ptsGitHub4,056 starsgithub.comOpen source2 reactionslatest reaction