Gazette – Build platforms that flexibly mix SQL, batch, and stream processing

Hi, I’m the primary author of gazette. Interesting seeing it here, happy to answer questions.<p>We’re continuing to improve it - it’s a core implementation detail of our current project &amp; company Estuary Flow (<a href="https:&#x2F;&#x2F;estuary.dev" rel="nofollow">https:&#x2F;&#x2F;estuary.dev</a>), which aims to further simplify and democratize low latency data products.

The slides [1] helped me grok what problems this tool solves pretty quickly.<p>Everything big data is moving to blob storage these days, but streaming can lead to small files problem or longer latencies. File fragments stored locally with proxied readers seems like a simple solution to that.<p>[1] <a href="https:&#x2F;&#x2F;gazette.readthedocs.io&#x2F;en&#x2F;latest&#x2F;overview-slides.html#" rel="nofollow">https:&#x2F;&#x2F;gazette.readthedocs.io&#x2F;en&#x2F;latest&#x2F;overview-slides.htm...</a>

The GitHub README and docs mention that Gazette has been running in production for 5 years, but I don’t see any mention of _where_. I assume this began as an internal project at some company - does anyone know which?

in the postgresql world logical replication is boon. out-of-band immutable datastore is key, as well.<p>we are looking forward to qualified replication in upcoming pg15.