Exploring the tree of LLM generations [video]
This is a simple text editor, made using gtkmm 3 and llama.cpp, that allows you to explore the possible continuations (ranked by descending probability) that an LLM would output after each token.
Reactions (1)
Similar products
by description similarity
Grammar Generator App for Llama.cpp
grammar.intrinsiclabs.aillama.cpp added context-free grammar guided generation functionality.
LLM verified with Monte Carlo Tree Search
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
STT –> LLM –> TTS pipeline in C
github.comPure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.
A quick and dirty LLM powered image describing tool