llama.rn

llama-cpp-python

Python bindings for llama.cpp

github.comOpen sourcelatest reaction 3 years ago

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

github.comSelf-hostedOpen sourcelatest reaction 3 years ago

Run Llama.cpp In-Process from Java with Project Panama FFM

deemwar-products.github.iolatest reaction 5 months ago

Grammar Generator App for Llama.cpp

llama.cpp added context-free grammar guided generation functionality.

grammar.intrinsiclabs.ailatest reaction 3 years ago

wllama

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

github.comOpen sourcelatest reaction 2 years ago