Run LLaMa2 on the Browser with Ggml.js
You can now build serverless AI inference web application with ggml.js's LM backends.
Reactions (1)
Similar products
by description similarity
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Gradient
gradient.aia web API for fine-tuning and deploying Llama2
I built Otis
triangllabs.aia minimal AI agent that runs local models out of the box
Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
Autonomously train research-agent LLMs on custom data using reinforcement learning and self-verification.