← Trending

Tangerine Index lists products launched since ChatGPT and people's reactions to them.

inference

github.com

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Open source

Visit github.comexternal siteGitHub9,649 starsexternal site

Install and connect

From the official MCP Registry, Homebrew, npm, PyPI, and crates.io. Matched by repository or domain once a day.

Reactions (1)

Similar products

by description similarity

  1. Inference Engine by GMI Cloud

    Fast multimodal-native inference at scale

    Product Hunt180 votesgmicloud.ailatest reaction

  2. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    InferX: Inference as a Service Platform

    Hacker News5 ptsGitHub6 starsgithub.comOpen source2 reactionslatest reaction

  3. LLM Playground

    compare results side by side

    Hacker News14 ptsretool.comlatest reaction

  4. LiteRT-LM

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    Hacker News5 ptsGitHub6,844 starsgithub.comLibraryOpen source2 reactionslatest reaction

  5. Free Inference Engineer and Model Training Roadmap

    Free, gamified roadmaps for LLM engineering: an Inference Engineering path (KV caches, CUDA kernels, production vLLM serving) and a Model Training path (pretraining on a budget, scaling laws, SFT/DPO/GRPO) — 185 tasks with auto-verified milestones instead of a paper certificate.

    Hacker News16 ptsinferquest.orglatest reaction