← 트렌딩

Tangerine Index는 ChatGPT 이후 나온 프로덕트와 사람들의 반응을 싣습니다.

oMLX

omlx.ai

Mac LLM server that cuts agent wait times from 90s to 5s

오픈소스

omlx.ai 방문외부 사이트GitHub23,477 스타외부 사이트

제작자가 쓴 설명

A native macOS inference server built on MLX. Paged SSD KV caching drops agent TTFT from 30-90s to under 5s. OpenAI & Anthropic compatible API for Apple Silicon. oMLX turns your Mac into a full LLM inference server, run from the menu bar.

반응 (2)

비슷한 프로덕트

설명이 비슷한 순

  1. Rapid-MLX

    Run local LLMs on Mac, 2-3x faster than alternatives

    Hacker News9점GitHub스타 4,119github.com데스크톱오픈소스반응 2개최근 반응

  2. SwiftLM

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Hacker News77점GitHub스타 797github.com모바일오픈소스반응 2개최근 반응

  3. mlx-serve

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    GitHub스타 2,411github.com데스크톱오픈소스최근 반응

  4. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    InferX: Inference as a Service Platform

    Hacker News5점GitHub스타 6github.com오픈소스반응 2개최근 반응

  5. Cuts Long Horizon Inference Costs by 50% via external KV Cache Offload

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Hacker News22점GitHub스타 2,884github.com오픈소스반응 2개최근 반응