Hey all, I've been working on this for about 11 months now and am really proud of how far the performance and utility of zpq has come.If you ever work with parquet files, locally or in s3-compatible object stores, I highly recommend giving it a try; I think you'll be impressed!There's a site for the project at https://zpq.chicagobuss.dev with my benchmark results and optimizations discussed in detail, as well as some material for the darker corners of Parquet like NaN and how you can write out the files so they're read faster by every other engine too. There's also a live playground to see the performance in action right in the browser.A personal blog post covers more about the motivation: https://chicagobuss.dev/blog/zpq-050/Happy to answer any questions! Comments URL: https://news.ycombinator.com/item?id=50301013 Points: 2

Comments: 0