← 최신 프로덕트

Tune LLaMa3.1 on Google Cloud TPUs

Felafax is building AI infra for non-NVIDIA GPUs. We’re building AI infra to fine-tune and serve LLMs on non-NVIDIA GPUs (TPUs, Trainium, AMD GPUs).

오픈소스

568 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. LLMKube

    github.com

    Kubernetes for Local LLMs with GPU Acceleration

    Hacker News5점

  2. Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU

    github.com

    High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.

    Hacker News395점

  3. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    github.com

    InferX: Inference as a Service Platform

    Hacker News5점

  4. Nexa SDK

    github.com

    Build powerful and efficient AI apps on edge devices

    Hacker News27점

  5. Can your GPU run this LLM?

    github.com

    Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

    Hacker News15점