Llama2 Embeddings FastAPI Server
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract. I just wanted a quick and easy way to easily submit strings to a REST API and get back the embedding vectors in JSON using Llama2 and other similar LLMs, so I put this together over the past couple days.
Open source
Reactions (1)
Similar products
by description similarity
Client Vector Search
clientvectorsearch.comEmbeddings and Semantic Search with 5 Lines
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Model2vec
github.comLightning-fast Static Embeddings for RAG/Semantic Search
Gradient
gradient.aia web API for fine-tuning and deploying Llama2
UForm v2
github.comtiny CLIP-like embeddings in 21 languages and Graphcore API