LMQL becomes simpler and adds llama.cpp

Similar products

by description similarity

1. Grammar Generator App for Llama.cpp

   grammar.intrinsiclabs.ai

   llama.cpp added context-free grammar guided generation functionality.

   HNHacker News19 pts

2. Open-source load balancer for llama.cpp

   github.com

   Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

   HNHacker News151 pts

3. Llama2.ipynb

   github.com

   Ipython notebook copy of Andrej Karpathy's llama2.c

   HNHacker News12 pts

4. Finetune Llama-3.1 2x faster in a Colab

   colab.research.google.com

   Just added Llama-3.1 support!

   HNHacker News16 pts

5. Llama.go

   github.com

   port of llama.cpp to pure Go

   HNHacker News25 pts