Show HN: A model index from the AI Gateways

Category: devtools

Tags: benchmarking, ai-gateway, infrastructure, cloud, performance

Score: 6.5/10 (Innovation: 6, Technical: 6, Documentation: 8, Utility: 6)

ComputeSDK Benchmarks is an open-source platform that publishes reproducible, provider-neutral performance benchmarks for AI agent infrastructure, including sandboxes, object storage, headless browsers, and AI gateways. It automates tests via GitHub Actions, commits results as JSON, and provides live leaderboards, aiming to bring transparency and comparability to cloud infrastructure choices. The project is notable for its independent, sponsor-supported model and machine-readable output for LLM agents.

Target audience: backend developers, devops engineers, AI platform engineers

Repository: https://www.computesdk.com/benchmarks/ai-gateway/models · TypeScript · MIT · 122 stars

View on Hacker News