← Latest products

Monitoring your OpenAI usage without a third party

"Batteries included" logging solution for your Azure OpenAI instance. LLM observability is an absolute must-have for anyone running something in prod (or prod-like).

Open source

73 stars · GitHubexternal site

Visit github.comexternal site

Reactions (1)

Similar products

by description similarity

  1. Open-source observability for LLM apps

    github.com

    LLMonitor helps you record, trace & search your LLM queries and chatbot conversations.

    Hacker News10 pts

  2. ML condenses billions of logs into a tiny snapshot your LLM can debug

    github.com

    Agent layer for observability

    Hacker News13 pts

  3. OpenLLMetry

    github.com

    OpenTelemetry-based observability for LLMs

    Hacker News154 pts

  4. LLMxRay an open-source observability tool for LLMs

    github.com

    LLMxRay — Local LLM Observatory. Full observability interface for Ollama: chat, streaming, reasoning, RAG, introspection, metrics.

    Hacker News11 pts

  5. Open-source LLM observability tool for lazy devs

    github.com

    As developers focused on iterating and building features as fast as possible, we felt observability would’ve been a helpful tool to have, but we found existing solutions had too much overhead to set up.

    Hacker News6 pts