Show HN: Submit asynchronous LLM batch jobs through one interface

Category: ai-ml

Tags: llm, batch-processing, api-wrapper, multi-provider, async

Score: 6.8/10 (Innovation: 6, Technical: 7, Documentation: 8, Utility: 6)

Batchlane provides a unified Python interface and CLI for submitting asynchronous batch jobs to multiple LLM providers, handling chunking, polling, and result joining. It offers resumable checkpoints and a stateless OpenAI-compatible gateway that lets existing OpenAI batch clients work with other providers. Only Anthropic is live-verified; others are contract-tested.

Target audience: AI/ML engineers and backend developers integrating LLM batch inference

Repository: https://github.com/gojiplus/batchlane · Python · MIT · 2 stars

View on Hacker News