top | item 42828047

(no title)

Rhubarrbb | 1 year ago

Writing to catalogs is still pretty new. Databricks has recently been pushing delta-kernel-rs that DuckDb has a connector set up for, and there’s support for writing via Python with the Polars package through delta-rs. For small-time developers this has been pretty helpful for me and influential in picking delta lake over iceberg.

discuss

order

kermatt|1 year ago

> influential in picking delta lake over iceberg

Can you expand on those reasons a bit?

The dependency on a catalog in Iceberg made it more complicated for simple cases than Delta, where a directory hierarchy was sufficient - if I was understanding the PyIceberg docs correctly.