Show HN: Pipelines – Language for scripting parrallel pipelines with Python

This looks pretty interesting.<p>Just curious if you looked at Apache Airflow as the integration functionality and pipeline &#x2F; DAG configuration approaches are similar and it&#x27;s also done in Python.<p><a href="https:&#x2F;&#x2F;github.com&#x2F;apache&#x2F;airflow" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;apache&#x2F;airflow</a><p>The Nim language is new to me. What was the experience like implementing a framework in it?

Looks interesting but I don’t understand if the “x as x” is mandatory? Seems overly verbose if you don’t want to import it with another name?

I&#x27;m not sure I understand the wins of this over just using the standard multiprocessing module.<p>You can trivially define a worker pool or arbitrary size and pipe a stream of values through your function using multiple cores, avoiding GIL issues.<p>If you have something which scales to multiple machines just use celery or redis streams.

Nice readme! It&#x27;s so common for projects to forget to include an introductory blurb, it&#x27;s great to see one that does not forget.<p>Small bug in the example code? I think this:<p><pre><code> return even % 2 == 0 </code></pre> Should be this:<p><pre><code> return number % 2 == 0</code></pre>

I didn&#x27;t understand one thing: is this implemented in Nim and run Python code? If yes, why don&#x27;t run Pipelines in Nim too? Wouldn&#x27;t this be faster?

wait... `&#x2F;&gt;` and `|&gt;` are python operators?

Should have named it Pypelines. But seriously though I am not sure what the benefits over multiprocessing are. It looks a little cryptic at first sight.

Looks very similar to R, dplyr and pipes.