Show HN: Lumabri – Run large AI models across your computers and servers.Pure C

Category: ai-ml

Tags: distributed-inference, llm, c, p2p, lan

Score: 7.3/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 6)

Lumabri is a C-based distributed inference engine that runs large AI models across multiple computers on a LAN, using a layer-wise sharding approach with explicit memory budgets and donor approval. It provides a terminal UI and bundled web chat for managing and using the swarm, with careful attention to security and resource accounting.

Target audience: AI enthusiasts and backend developers with multiple machines seeking private, local LLM inference

Repository: https://github.com/JustVugg/lumabri/blob/main/README.md · C · Apache-2.0 · 187 stars

View on Hacker News