← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

OlliteRT

github.com

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

MobileOpen source

Visit github.comexternal siteGitHub627 starsexternal site

Reactions (1)

Similar products

by description similarity

  1. candle-vllm

    Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

    GitHub739 starsgithub.comOpen sourcelatest reaction

  2. OpenArc

    Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.

    Hacker News17 ptsGitHub548 starsgithub.comOpen source2 reactionslatest reaction

  3. conduit

    Native iOS and Android client for Open WebUI, direct OpenAI-compatible, Ollama, and Hermes agents.

    GitHub2,431 starsgithub.comMobileSelf-hostedOpen sourcelatest reaction

  4. ChatMock

    OpenAI & Ollama compatible API powered by Codex

    GitHub1,566 starsgithub.comOpen sourcelatest reaction

  5. LiteRT-LM

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    Hacker News5 ptsGitHub6,853 starsgithub.comLibraryOpen source2 reactionslatest reaction