Show HN: Busbar self-hosted execution boundary for Agentic Apps

Category: infrastructure

Tags: ai-gateway, rust, self-hosted, model-routing, execution-boundary, protocol-translation

Score: 7.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 7)

Busbar is a self-hosted Rust binary that acts as an execution boundary for AI applications, sitting between apps and model providers to enforce policy, budgets, routing, and audit evidence. It supports six model wire protocols (OpenAI, Anthropic, Gemini, Cohere, Bedrock, etc.) with cross-protocol translation and native SDK compatibility via simple base URL swaps, while staying extremely lightweight and fast (73µs added latency p50, 7.3 MiB idle memory). The project differentiates from LiteLLM and API gateways by focusing on a governed hot path with a small static binary and broad protocol pair coverage.

Target audience: devops, backend devs, platform engineers, AI infrastructure teams

Repository: https://github.com/GetBusbar/busbar · Rust · Apache-2.0 · 212 stars

View on Hacker News