Llama-8B Teaches Itself Baby Steps to Deep Research Using RL
Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification. I've been tinkering with getting Llama-8B to bootstrap its own research skills through self-play.
Open source
Reactions (1)
Similar products
by description similarity
A complete end-to-end pipeline for LLM interpretability with sparse autoencoders (SAEs) using Llama 3.2, written in pure PyTorch and fully reproducible.
RL Agent that can auto-optimize your LLM prompts
nomadic-ml.github.ioAlong with my team, I've developed a reinforcement learning system that automatically optimizes LLM prompts, complete with a visualization feature to track both prompt structure and learning progress over time.
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Khoj
github.comChat offline with your second brain using Llama 2
ART
github.coma new open-source RL framework for training agents