top | item 46751769 (no title) shortishly | 1 month ago Tansu author here. Storage is a pluggable choice of: PostgreSQL, memory, SQLite or S3. There are others in the pipeline (SlateDB, ...). discuss order hn newest youngtaff|1 month ago Any chance of a Parquet compatible storage choice? shortishly|1 month ago Yes: with a schema backed topic (AVRO, JSON or Protocol buffer) Tansu can write to Apache Iceberg, Delta or Parquet. You can use a Sink topic to write directly to an open table format (including Parquet) skipping (most of) the Kafka metadata.https://blog.tansu.io/articles/parquet
youngtaff|1 month ago Any chance of a Parquet compatible storage choice? shortishly|1 month ago Yes: with a schema backed topic (AVRO, JSON or Protocol buffer) Tansu can write to Apache Iceberg, Delta or Parquet. You can use a Sink topic to write directly to an open table format (including Parquet) skipping (most of) the Kafka metadata.https://blog.tansu.io/articles/parquet
shortishly|1 month ago Yes: with a schema backed topic (AVRO, JSON or Protocol buffer) Tansu can write to Apache Iceberg, Delta or Parquet. You can use a Sink topic to write directly to an open table format (including Parquet) skipping (most of) the Kafka metadata.https://blog.tansu.io/articles/parquet
youngtaff|1 month ago
shortishly|1 month ago
https://blog.tansu.io/articles/parquet