← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

LiteRT-LM

github.com

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

LibraryOpen source

Visit github.comexternal siteGitHub6,844 starsexternal site

Install and connect

From the official MCP Registry, Homebrew, npm, PyPI, and crates.io. Matched by repository or domain once a day.

Reactions (2)

Similar products

by description similarity

  1. LiteRT

    LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

    GitHub3,578 starsgithub.comLibraryOpen sourcelatest reaction

  2. vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Hacker News108 ptsGitHub96,591 starsgithub.comOpen source3 reactionslatest reaction

  3. large-language-models

    Notebooks for Large Language Models (LLMs) Specialization

    GitHub831 starsgithub.comOpen sourcelatest reaction

  4. llm2vec

    Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

    GitHub1,730 starsgithub.comOpen sourcelatest reaction

  5. FastEdit

    🩹Editing large language models within 10 seconds⚡

    GitHub1,368 starsgithub.comOpen sourcelatest reaction