Show HN: LLMxRay an open-source observability tool for LLMs

Category: observability

Tags: llm, observability, ollama, proxy, local-ai

Score: 7.3/10 (Innovation: 7, Technical: 7, Documentation: 8, Utility: 7)

LLMxRay is an open-source observability proxy for local LLMs (Ollama) that intercepts requests on a separate port and provides detailed insights into prompt composition, caching behavior, model loading, and performance. It helps developers understand what their AI tools are actually sending, identify inefficiencies, and debug agent workflows without cloud dependencies.

Target audience: AI developers, backend engineers, devops, and researchers working with local LLMs

Repository: https://github.com/LogneBudo/llmxray · Vue · Apache-2.0 · 28 stars

View on Hacker News