← 최신 프로덕트

Inferless

Deploy any machine learning models in minutes. Generate Glue Code in seconds to simplify your Nvidia Triton Inference Server Deployments. Deploy any machine learning model in production stress-free with ultra-low cold starts.

오픈소스

21 스타 · GitHub외부 사이트

inferless.com 방문외부 사이트

반응 (2)

비슷한 프로덕트

설명이 비슷한 순

  1. SIE Serverless

    superlinked.com

    managed inference powered by self-hostable stack

    Hacker News9점

  2. Serve 100 Large AI models on a single GPU with low impact to TTFT

    github.com

    I wanted to build an inference provider for proprietary AI models, but I did not have a huge GPU farm.

    Hacker News7점

  3. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    github.com

    InferX: Inference as a Service Platform

    Hacker News5점

  4. We made our own inference engine for Apple Silicon

    github.com

    A high-performance inference engine for AI models

    Hacker News186점

  5. ML Blocks

    mlblocks.com

    Deploy multimodal AI workflows without code

    Hacker News112점