TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: Bytewax – Python Stateful Stream Processing on Timely Dataflow

21 pointsby amathalmost 3 years ago

7 comments

willempienaaralmost 3 years ago
Been following this project for a while. There's a reason why it's making waves in developer circles - You get a simple to use Python developer experience with a powerful distributed data processing framework that scales to enormous workloads. Plus its battle tested since it relies on Timely Dataflow under the hood.
m6c6almost 3 years ago
This looks cool bc you get the best of both worlds with a good developer experience in Python, but the performance of Rust. Are there any examples of scaling it on Kubernetes, that&#x27;d be an interesting evaluation.<p>Are you open to contributors btw? I&#x27;m interested in learning more about Python &lt;&gt; Rust bindings.
评论 #32141028 未加载
mloncodealmost 3 years ago
Bytewax is the first streaming data python client that I can finally get my head around. I&#x27;ve used Bytewax and I love the developer experience, you folks really dialed it in there.<p>Also the docs are great, which many developer tools tend to neglect. Good docs are the first thing I notice when looking at a project.<p>Great work, and congrats on the launch.
评论 #32112889 未加载
caravelalmost 3 years ago
This is much more straightforward than your JVM-based, huge infra solutions like Flink. For when you need something that is familiar [python] and just works.
agallegoalmost 3 years ago
I think this is a good architecture to focus on the developer experience. A rust runtime with a Python front end. Very cool to see
shruts02almost 3 years ago
Pretty cool! Have you added anything to Timely Dataflow yet or is this just Python bindings?
评论 #32099989 未加载
TheIronYuppiealmost 3 years ago
Does this work on a single node only, or does it work across a cluster like Kubernetes?
评论 #32104093 未加载