Show HN: Zpq 0.5.0 – A zero-dependency Parquet engine in Zig
Category: devtools
Tags: parquet, zig, cli, sql, s3, query-engine, data-processing
Score: 7.5/10 (Innovation: 7, Technical: 8, Documentation: 8, Utility: 7)
zpq is a zero-dependency Parquet engine written in Zig, offering a CLI tool that queries, filters, aggregates, and rewrites Parquet files locally or on S3, with SQL support and multiple output formats. It claims significant performance advantages over DuckDB and Polars on benchmarks, and includes an AWS Lambda integration and a C library for embedding. The project is notable for its from-scratch implementation in Zig, careful optimizations like page pruning and exact decimal handling, and thorough documentation.
Target audience: data engineers, backend developers, devops, data scientists
Repository: https://github.com/chicagobuss/zpq · Zig · MIT · 6 stars
View on Hacker News