Storing data at scale with compression and indexes, Defining an industrial-strength on-disk format
It's a specialized format for efficient large-scale data storage, not a general-purpose file type.
Simple data exchange where lightweight formats like JSON are sufficient
Reviews from businesses like yours — matched by size and type. Available once you create a profile.
Complete profileRelated Tools
Community Reviews
Reviews from Reddit, Product Hunt, Hacker News & AlignAI members
DuckDB + Parquet is a way nicer angle than what I had in mind.
Hacker News • HackerNews • Use case: Format for performance trace data in conjunction with DuckDB
Depending on your needs, the right tool might be Parquet or Arrow or protobuf or Cap’n Proto or even JSON or XML or ASN.1.
Hacker News • HackerNews • Use case: Defining an industrial-strength on-disk format.
I think parquet and arrow are great formats... parquet arrow on top of that solve many more problems needed to store data at scale.
Hacker News • HackerNews • Use case: Storing data at scale, benefiting from its well-defined format and features like compression and indexes.
Have You Used This Tool?
Sign in to share your experience with this tool.
Sign in