← 최신 프로덕트

Llama2 Embeddings FastAPI Server

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract. I just wanted a quick and easy way to easily submit strings to a REST API and get back the embedding vectors in JSON using Llama2 and other similar LLMs, so I put this together over the past couple days.

오픈소스

1,052 스타 · GitHub외부 사이트

github.com 방문외부 사이트

반응 (1)

비슷한 프로덕트

설명이 비슷한 순

  1. Client Vector Search

    clientvectorsearch.com

    Embeddings and Semantic Search with 5 Lines

    Hacker News11점

  2. A fully open-source (Apache 2.0)implementation of llama

    github.com

    Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

    Hacker News158점

  3. Model2vec

    github.com

    Lightning-fast Static Embeddings for RAG/Semantic Search

    Hacker News28점

  4. Gradient

    gradient.ai

    a web API for fine-tuning and deploying Llama2

    Hacker News26점

  5. UForm v2

    github.com

    tiny CLIP-like embeddings in 21 languages and Graphcore API

    Hacker News16점