Show HN: Decido – an open decision model that runs CPU-only on a laptop

Category: ai-ml

Tags: decision-making, llm, cpu-inference, local-ai, gguf

Score: 7.0/10 (Innovation: 7, Technical: 8, Documentation: 7, Utility: 6)

Decido is an open-source decision model that runs CPU-only on a laptop, providing calibrated yes/no, pick-one, and rating decisions about documents. It is a LoRA fine-tune of Gemma 4 26B-A4B shipped as an 8-bit GGUF for llama.cpp, with a custom server (vserve) that caches state for deterministic per-machine answers. It offers a wire-compatible alternative to TypeSafe's Jev API, focusing on reproducibility and local execution.

Target audience: AI/ML engineers, backend developers

Repository: https://github.com/decido-ai/decido · Python · Apache-2.0

View on Hacker News