Show HN: Bytewax – Python Stateful Stream Processing on Timely Dataflow

Been following this project for a while. There's a reason why it's making waves in developer circles - You get a simple to use Python developer experience with a powerful distributed data processing framework that scales to enormous workloads. Plus its battle tested since it relies on Timely Dataflow under the hood.

This looks cool bc you get the best of both worlds with a good developer experience in Python, but the performance of Rust. Are there any examples of scaling it on Kubernetes, that&#x27;d be an interesting evaluation.<p>Are you open to contributors btw? I&#x27;m interested in learning more about Python &lt;&gt; Rust bindings.

Bytewax is the first streaming data python client that I can finally get my head around. I&#x27;ve used Bytewax and I love the developer experience, you folks really dialed it in there.<p>Also the docs are great, which many developer tools tend to neglect. Good docs are the first thing I notice when looking at a project.<p>Great work, and congrats on the launch.

This is much more straightforward than your JVM-based, huge infra solutions like Flink. For when you need something that is familiar [python] and just works.

I think this is a good architecture to focus on the developer experience. A rust runtime with a Python front end. Very cool to see

Pretty cool! Have you added anything to Timely Dataflow yet or is this just Python bindings?

Does this work on a single node only, or does it work across a cluster like Kubernetes?