← Latest products

Tune LLaMa3.1 on Google Cloud TPUs

Felafax is building AI infra for non-NVIDIA GPUs. We’re building AI infra to fine-tune and serve LLMs on non-NVIDIA GPUs (TPUs, Trainium, AMD GPUs).

Open source

568 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. LLMKube

    github.com

    Kubernetes for Local LLMs with GPU Acceleration

    Hacker News5 pts

  2. Llama 3.1 70B on a single RTX 3090 via NVMe-to-GPU bypassing the CPU

    github.com

    High-efficiency LLM inference engine in C++/CUDA. Run Llama 70B on RTX 3090.

    Hacker News395 pts

  3. 50+ LLMs on 2 GPUs with 2-Second Swapping? We built AI-Native Runtime

    github.com

    InferX: Inference as a Service Platform

    Hacker News5 pts

  4. Nexa SDK

    github.com

    Build powerful and efficient AI apps on edge devices

    Hacker News27 pts

  5. Can your GPU run this LLM?

    github.com

    Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

    Hacker News15 pts