Exploring the tree of LLM generations [video]
This is a simple text editor, made using gtkmm 3 and llama.cpp, that allows you to explore the possible continuations (ranked by descending probability) that an LLM would output after each token.
반응 (1)
비슷한 프로덕트
설명이 비슷한 순
Grammar Generator App for Llama.cpp
grammar.intrinsiclabs.aillama.cpp added context-free grammar guided generation functionality.
LLM verified with Monte Carlo Tree Search
LLM
github.coma Rust Crate/CLI for CPU Inference of LLMs (LLaMA, GPT-NeoX, etc.)
STT –> LLM –> TTS pipeline in C
github.comPure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.
A quick and dirty LLM powered image describing tool