Show HN: Bifrost – High-performance AI gateway

Category: infrastructure

Tags: ai-gateway, llm, load-balancing, semantic-caching, go, openai-compatible

Score: 7.5/10 (Innovation: 6, Technical: 8, Documentation: 8, Utility: 8)

Bifrost is a high-performance AI gateway written in Go that unifies access to 20+ LLM providers through a single OpenAI-compatible API with automatic failover, load balancing, and semantic caching. Its sub-11µs overhead at 5,000 RPS and drop-in replacement capability make it compelling for teams running production AI workloads across multiple providers.

Target audience: backend devs, devops, platform engineers, AI application developers

Repository: https://github.com/maximhq/bifrost · Go · Apache-2.0 · 9002 stars

View on Hacker News