← νŠΈλ Œλ”©

Tangerine IndexλŠ” ChatGPT 이후 λ‚˜μ˜¨ ν”„λ‘œλ•νŠΈμ™€ μ‚¬λžŒλ“€μ˜ λ°˜μ‘μ„ μ‹£μŠ΅λ‹ˆλ‹€.

catwalk

github.com

🐈 A collection of LLM inference providers and models

μ˜€ν”ˆμ†ŒμŠ€

github.com λ°©λ¬Έμ™ΈλΆ€ μ‚¬μ΄νŠΈGitHub822 μŠ€νƒ€μ™ΈλΆ€ μ‚¬μ΄νŠΈ

λ°˜μ‘ (1)

λΉ„μŠ·ν•œ ν”„λ‘œλ•νŠΈ

μ„€λͺ…이 λΉ„μŠ·ν•œ 순

  1. sonar

    Large-scale LLM inference engine

    GitHubμŠ€νƒ€ 1,905github.comμ˜€ν”ˆμ†ŒμŠ€μ΅œκ·Ό λ°˜μ‘

  2. guidellm

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    GitHubμŠ€νƒ€ 1,762github.comμ˜€ν”ˆμ†ŒμŠ€μ΅œκ·Ό λ°˜μ‘

  3. rtp-llm

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    GitHubμŠ€νƒ€ 1,394github.comμ˜€ν”ˆμ†ŒμŠ€μ΅œκ·Ό λ°˜μ‘

  4. optillm

    Optimizing inference proxy for LLMs

    GitHubμŠ€νƒ€ 4,338github.comμ˜€ν”ˆμ†ŒμŠ€μ΅œκ·Ό λ°˜μ‘

  5. dotLLM

    LLM inference engine written in .NET

    GitHubμŠ€νƒ€ 528github.comμ˜€ν”ˆμ†ŒμŠ€μ΅œκ·Ό λ°˜μ‘