Show HN: LLMBrake – Per-customer dollar caps for OpenAI/Anthropic API calls

Category: devtools

Tags: llm, cost-control, api-wrapper, budgeting, openai

Score: 6.5/10 (Innovation: 5, Technical: 7, Documentation: 8, Utility: 6)

LLMBrake is a TypeScript library that wraps OpenAI-compatible API calls to enforce per-customer monthly dollar budgets, automatically downgrading models near the cap and blocking calls at the cap. It stands out for its metadata-only design, support for streaming and multiple providers, and a reserving store that mitigates concurrent overshoot, though the hosted cloud service introduces a commercial dependency.

Target audience: backend and full-stack developers building AI apps with per-customer billing

Repository: https://github.com/llmbrake/llmbrake · Python · MIT

View on Hacker News