Show HN: Sonia. Local AI Assistant Linux. 13Gb RAM, No GPU, Skills Supported

Category: ai-ml

Tags: voice-assistant, local-ai, llm, asr, tts, full-duplex, function-calling, typescript

Score: 7.3/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 6)

Sonia is a local, GPU-free voice assistant that combines LLM, streaming ASR/TTS, and VAD into a full-duplex barge-in capable agent running in under 15 GB RAM. Its layered turn detection (Silero VAD + Silence + Smart Turn + LLM judge) and tool-gated function calling are notable engineering choices for running small local models reliably.

Target audience: enthusiasts and developers running local LLM stacks on consumer hardware; AI/ML engineers interested in real-time speech pipelines

Repository: https://github.com/grigio/sonia-assistant · TypeScript · GPL-3.0 · 57 stars

View on Hacker News