Show HN: Execute SQL against Bluesky firehose

Hello, I’ve been working on a project that embeds duckdb for stream processing.<p>I just added support for websocket sources which enables sql over the Bluesky firehouse.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;turbolytics&#x2F;sql-flow?tab=readme-ov-file#consuming-bluesky-firehose">https:&#x2F;&#x2F;github.com&#x2F;turbolytics&#x2F;sql-flow?tab=readme-ov-file#c...</a><p>Duckdb does all the sql execution, and python is responsible for sourcing the data.<p>The project is still quite young and I’m very much still experimenting, but I’d love any feedback. Thank you.

Hello! Just released a version of SQLFlow that adds support for streaming data to iceberg tables.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;turbolytics&#x2F;sql-flow?tab=readme-ov-file#streaming-to-iceberg">https:&#x2F;&#x2F;github.com&#x2F;turbolytics&#x2F;sql-flow?tab=readme-ov-file#s...</a><p>pyiceberg does the heavy lifting. It is a great project with a lot of active development.<p>It&#x27;s interesting to see how immature iceberg ecosystem is. For example duckdb iceberg does not support writing to tables, neither does the go iceberg project. Iceberg writing was just recently added to the pyiceberg project!<p>Would love to learn more about peoples actual use of iceberg in the wild.<p>Are you using iceberg? How are you writing data to it? Which iceberg features are you using? Do you leverage snapshots at all?<p>Thank you

Created a tutorial on using SQLFlow to interact with the Bluesky firehose:<p><a href="https:&#x2F;&#x2F;www.linkedin.com&#x2F;pulse&#x2F;learning-sqlflow-using-bluesky-firehose-turbolytics-io4je&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.linkedin.com&#x2F;pulse&#x2F;learning-sqlflow-using-bluesk...</a>