Show HN: Commit-Aware Router, route LLM traffic around your AI/cloud commitments

Category: ai-ml

Tags: llm-routing, finops, cost-optimization, privacy, policy-engine

Score: 6.0/10 (Innovation: 7, Technical: 5, Documentation: 7, Utility: 5)

Commit-Aware Router is a routing layer for LLM traffic that considers an organization's commercial commitments (e.g., prepaid cloud spend, minimum-spend agreements) in addition to traditional metrics like cost and latency. It separates sensitive financial data from routing via a customer-local policy signal, aiming to align AI routing decisions with FinOps goals. The project is an early proof of concept with LiteLLM integration and a focus on privacy and multi-channel commitments.

Target audience: AI platform engineers, FinOps teams, cloud infrastructure teams, and finance stakeholders managing AI/cloud commitments

Repository: https://github.com/tejaspruthi/CommitAwareRouter · Python · Apache-2.0 · 2 stars

View on Hacker News