← 최신 프로덕트

Red Candle

Run LLMs Natively in Ruby with Rust. Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration. I've been working on Red Candle, a Ruby gem that runs LLMs (Llama, Mistral, Gemma, Phi) directly in your Ruby process through Rust bindings (based on the candle crate from Hugging Face).

오픈소스

205 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Incremental JSON parser for streaming LLM tool calls in Ruby

    aha.io

    Modern LLM providers can stream their responses. This is great for user experience — instead of a loading spinner, users see the response being generated in real time. They can also call external functions (also called "tools"): search your database

    Hacker News13점

  2. Offeryn

    github.com

    Build Tools for LLMs in Rust, with Model Context Protocol

    Hacker News7점

  3. liteLLM Proxy Server

    github.com

    50+ LLM Models, Error Handling, Caching

    Hacker News140점

  4. LLM

    github.com

    a Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)

    Hacker News45점

  5. LLM Rescuer

    github.com

    Fixing the billion dollar mistake in Ruby

    Hacker News96점