Onyx: fault tolerant data processing for Clojure

This looks very interesting. I&#x27;m doing some log file processing in Apache Spark in Clojure. Spark is written in Scala, but has a Java API, which is wrapped by Flambo. It looks and feels entirely Clojure.<p>The semantics look very similar indeed. Does anyone have a comparison between Onyx and Spark?

Hi folks! I&#x27;m Michael Drogalis - the primary author. I&#x27;m happy to answer any questions.

Checkout the original video introducing Onyx: <a href="http://youtu.be/vG47Gui3hYE" rel="nofollow">http:&#x2F;&#x2F;youtu.be&#x2F;vG47Gui3hYE</a>

If this interests you, then you should also check out the post where Michael Drogalis first introduced this:<p><a href="http://michaeldrogalis.tumblr.com/post/98143185776/onyx-distributed-data-processing-for-clojure" rel="nofollow">http:&#x2F;&#x2F;michaeldrogalis.tumblr.com&#x2F;post&#x2F;98143185776&#x2F;onyx-dist...</a>

Re: Onyx&#x27;s architecture. I would wonder about performance when keeping a shared log in ZooKeeper. Why not use something like Kafka -- it is designed for high-volume, immutable logging. ZK works best for less-frequently changing configuration, such as node connection information or snapshotting. I could be wrong. I&#x27;d like to hear your thoughts and experience.

Looks superficially simmilar to <a href="https://github.com/aphyr/tesser" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;aphyr&#x2F;tesser</a> anyone know both and can give a comparison?<p>From a brief examination tesser looks a lot simpler (probably because of encoding most of the folding using various monoids). Does onyx have a similar abstraction model that I missed?