Reducing LLM input tokens by 70%

비슷한 프로덕트

설명이 비슷한 순

1. A fully open-source (Apache 2.0)implementation of llama

   github.com

   Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

   HNHacker News158점

2. GPT Router

   github.com

   Open-Source API Gateway for LLMs (OpenAI, Anthropic, etc.)

   HNHacker News15점

3. Open-source LLM provider price comparison

   github.com

   This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table

   HNHacker News125점

4. 80% faster

   github.com

   50% less memory, 0% loss of accuracy Llama finetuning

   HNHacker News385점

5. Butter

   docs.butter.dev

   a muscle memory cache for LLMs

   HNHacker News23점