← 트렌딩

Tangerine Index는 ChatGPT 이후 나온 프로덕트와 사람들의 반응을 싣습니다.

TensorRT-LLM

github.com

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

오픈소스

github.com 방문외부 사이트GitHub15,046 스타외부 사이트

설치·연결

공식 MCP Registry, Homebrew, npm, PyPI, crates.io에서 저장소나 도메인으로 맞춰 하루 한 번 가져옵니다.

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. LLGTRT

    TensorRT-LLM+Rust server w/ OpenAI-compat and Structured Output

    Hacker News6점GitHub스타 73github.com오픈소스반응 2개최근 반응

  2. Qwen-TensorRT-LLM

    GitHub스타 618github.com오픈소스최근 반응

  3. LLM

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점GitHub스타 6,145github.comCLI오픈소스반응 2개최근 반응

  4. TensorSharp

    A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    GitHub스타 667github.com오픈소스최근 반응

  5. LLM CLI tool now supports self-hosted language models via plugins

    LLM is my command-line utility and Python library for working with large language models such as GPT-4. I just released version 0.5 with a huge new feature: you can now …

    Hacker News6점simonwillison.netCLI셀프 호스팅반응 2개최근 반응