TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Octobot - A Low-Latency, Highly Parallel Distributed Task Queue Worker

105 pointsby cscottaover 14 years ago

13 comments

Sukottoover 14 years ago
This is a good case-study of what to do when building a home page for your project.<p>1) State what your project is about using language that a reasonably savvy (technology-wise) user can understand, even if unfamiliar with the problem domain. (this site would be better if they linked on "message queue" for those people that don't know what that is.)<p>2) Eye-catching call to action icons<p>3) Brief list of most important features<p>4) Brief high-level view<p>5) Brief low-level view<p>6) Some clean and minimalist stats on why you might want to use it<p>7) Easy to understand links to more info.<p>I don't know if I will ever need this product... but I'm bookmarking it anyway as an <i>outstanding</i> example of how to introduce people to it. (Except for the swear word. The word "Fucking" is really out of place)<p>Nice job guys.
评论 #1709907 未加载
评论 #1711876 未加载
评论 #1710925 未加载
evgenover 14 years ago
The throughput numbers on the chart would have seemed a bit more valid if the task had not included stuffing the result into a protobuf given the notoriously slow performance of the standard python protobuf implementation that would have been used by Celery and PyInvoke. If they wanted to impress, or at least be honest, the data would have stayed in JSON the whole way through the stack and the worker task would have been a simple string manipulation of something similar.
评论 #1709758 未加载
chrisduesingover 14 years ago
Am I the only one who got really excited upon seeing the domain was octobot.taco.cat, and then very confused when going to www.taco.cat? It seems to be an art gallery in Spanish or something...<p>I realize this is not germane to the topic, but .cat!? What other really interesting tld's exist that I have never heard about?
评论 #1710380 未加载
评论 #1710485 未加载
评论 #1710129 未加载
moeover 14 years ago
Looks interesting at a glance.<p>But guys, seriously, make your docs available in HTML format. PDF-only docs are out of fashion since the 90s.
gmcquillanover 14 years ago
Fascinating. The thing I find interesting about this service is that it seems to work seamlessly with multiple queue backends. That would have been really useful at my company, where we completely swapped out our queue server infrastructure. Nice work!
johngaltover 14 years ago
Sorry to be the slow one here... What is a Distributed Task Queue Worker? What problem does it solve?
评论 #1710547 未加载
jnollerover 14 years ago
Interesting; I'm looking forward to comparing/contrasting this with my current favorite - Celery (<a href="http://celeryproject.org/" rel="nofollow">http://celeryproject.org/</a>) which supports a variety of backends.
metabrewover 14 years ago
I like that it has the capability to be an email queue build in, by supporting SMTP/SSL. Worth installing just for that, since that's the first thing lots of websites want a message queue for.
DEinspanjerover 14 years ago
Very interesting. We're currently working on a quick project to test integrating Hazelcast into a distributed server to use as a queue. Did you look at it by any chance? Curious if it was missing something that you needed.
评论 #1710102 未加载
waratumanover 14 years ago
Interesting, but won't ever use. It also seems that it is just wrapping typical queueing systems, which I would use anyways because this only supports the JVM.
评论 #1709977 未加载
swahover 14 years ago
Surprised to see it wasn't written in Scala, since Scala shows up before in their list of supported languages and Scala code example also comes first.
dataguyover 14 years ago
Sounds like a nice tool. Will definitely give it a try for high work-load statistical data processing.
thereover 14 years ago
did anyone else have to take a second look at that domain name?
评论 #1710323 未加载