Show HN: A language model that lives in a boot sector

Category: ai-ml

Tags: boot-sector, int8-quantization, x86-assembly, tiny-ml, retro-computing

Score: 5.8/10 (Innovation: 7, Technical: 8, Documentation: 6, Utility: 2)

bootgpt is a 512-byte boot sector that loads an 11.5 KB int8 neural network from subsequent sectors and runs it in 16-bit real mode on a 386 to generate fake Linux boot logs. It's an impressive feat of assembly-level engineering and quantization, pushing inference into extreme constraints, though the practical utility is essentially limited to novelty and education.

Target audience: systems programmers, embedded developers, retro computing enthusiasts, ML hobbyists

Repository: https://github.com/kerlenton/bootgpt · Python · MIT

View on Hacker News