Show HN: I removed every float from GPT-2 for identical neural compression

Category: devtools

Tags: compression, gpt-2, integer-arithmetic, cross-platform, rust

Score: 6.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 3)

Taco is a lossless compressor that uses GPT-2 with integer-only arithmetic to ensure bit-identical model predictions across all CPUs and GPUs, enabling cross-platform decompression. It provides a reproducible integer specification, multiple backends (CPU, CUDA, Vulkan), and conformance tests, with impressive compression ratios, though it is currently slow and alpha-quality.

Target audience: backend devs, systems engineers, ML infrastructure engineers

Repository: https://github.com/tac0mania/taco · Rust · Apache-2.0 · 8 stars

View on Hacker News