Show HN: VernLLM – LLM fallback, no gateway

Category: devtools

Tags: llm, resilience, fallback, circuit-breaker, rate-limiting, typescript

Score: 6.3/10 (Innovation: 6, Technical: 6, Documentation: 7, Utility: 6)

VernLLM is a TypeScript library that provides an in-process LLM call framework with resilience features like fallback, circuit breaking, rate limiting, and caching across multiple providers. It eliminates the need for a separate gateway by embedding these capabilities directly into your application, offering observability and control for every LLM call.

Target audience: backend developers

Repository: https://vernllm.dev/ · TypeScript · MIT · 4 stars

View on Hacker News