Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

better compression https://opentelemetry.io/blog/2023/otel-arrow/

You don't do high performance without knowing the data schema.



Is Arrow better than Parquet or Protobuf?


Arrow is an in-memory columnar format, kinda orthogonal to parquet (which is an at-rest format). Protobuf is a better comparison, but it's more message oriented and not suited for analytics.


Not having to write to disk is great, and zero-copy in memory access is instant...


the blog post comparison is against OTLP which is protobuf




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: