It gives me immense joy to announce that we OLake’s (olake.io/docs) now supports Postgres as a data souce. Now you can:<p>1. Sync Postgres -> AWS S3 in parquet format [JSON dump and Level 1 flattened data support]
2. Sync Postgres -> Iceberg [in a few days, schema evolution support of Iceberg]
3. Sync Postgres -> Local Filestorage with everything we support for S3.<p>Want to test it out locally?
Sync Postgres via OLake -> MinIO (using JDBC catalog) -> Query using Engines that support Iceberg V2 tables [doc launching pretty soon]<p>We talked with 100s of DE’s to understand their pain point and the two major issues for them were replicating Postgres and MySQL to a lakehouse format. They said, we delivered.<p>Our source connectors and writers are independent, meaning that after Apache Iceberg writers are being supported (PR - <a href="https://github.com/datazip-inc/olake/pull/113" rel="nofollow">https://github.com/datazip-inc/olake/pull/113</a>), any new connector will be able to dump to Iceberg with minimal changes!