[dionian]

Have you considered something like iceberg tables?

[aynyc]

Yes, but parquet hates small files.

[dionian]

You can't compact? i.e. iceberg maintenance