Show HN: Snap – local first decision engine open weight
Category: ai-ml
Tags: llm-inference, decision-engine, logits, local-first, rust
Score: 7.3/10 (Innovation: 7, Technical: 7, Documentation: 8, Utility: 7)
Snap is a local-first decision engine that extracts probability distributions over predefined options (labels, booleans, scores) directly from an LLM's logits in a single pass, eliminating text generation and parsing. It batches multiple questions over a shared KV cache and offers a Jev-compatible API, promising deterministic, injection-resistant outputs for LLM pipelines.
Target audience: backend developers building LLM pipelines, data engineers, and AI engineers
Repository: https://emnlmn.github.io/snap/ · Rust · MIT · 8 stars
View on Hacker News