LMQL becomes simpler and adds llama.cpp

비슷한 프로덕트

설명이 비슷한 순

1. Grammar Generator App for Llama.cpp

   grammar.intrinsiclabs.ai

   llama.cpp added context-free grammar guided generation functionality.

   HNHacker News19점

2. Open-source load balancer for llama.cpp

   github.com

   Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

   HNHacker News151점

3. Llama2.ipynb

   github.com

   Ipython notebook copy of Andrej Karpathy's llama2.c

   HNHacker News12점

4. Finetune Llama-3.1 2x faster in a Colab

   colab.research.google.com

   Just added Llama-3.1 support!

   HNHacker News16점

5. Llama.go

   github.com

   port of llama.cpp to pure Go

   HNHacker News25점