TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: Sink 5000 rows/SEC from Kafka –> Postgres using Python and 250MiB Mem

2 pointsby dm035143 months ago
Hello! I&#x27;ve been working on building a flink alternative using DuckDB.<p>Building off of DuckDB makes it easy to leverage all the integrations DuckDB supports.<p>Using batching it&#x27;s trivial to insert 5000 rows &#x2F; second into a small postgres instance running locally in docker!<p>Would love your thoughts and feedback, thank you!<p>What do your data stacks look like for doing this non-differentiating data work like connecting streams and sources together?

no comments

no comments