TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

A list of queueing libraries

44 pointsby strzalekalmost 12 years ago

16 comments

wslhalmost 12 years ago
He didn&#x27;t mention IBM WebSphere MQ or Oracle Tuxedo that have being used in complex scenarios before the products in the list.<p>I would add my implementations and resources, even if they were for educational purposes:<p>i) Persisting Native Python Queues: <a href="http://blog.databigbang.com/persisting-native-python-queues/" rel="nofollow">http:&#x2F;&#x2F;blog.databigbang.com&#x2F;persisting-native-python-queues&#x2F;</a><p>ii) Adding Acknowledgement Semantics to a Persistent Queue: <a href="http://blog.databigbang.com/adding-acknowledgement-semantics-to-a-persistent-queue/" rel="nofollow">http:&#x2F;&#x2F;blog.databigbang.com&#x2F;adding-acknowledgement-semantics...</a><p>iii) Esoteric Queue Scheduling Disciplines (an essay about a new kind of queue): <a href="http://blog.databigbang.com/esoteric-queue-scheduling-disciplines/" rel="nofollow">http:&#x2F;&#x2F;blog.databigbang.com&#x2F;esoteric-queue-scheduling-discip...</a><p>iv) Using Queues in Web Crawling and Analysis Infrastructure (just informative): <a href="http://blog.databigbang.com/using-queues-in-web-crawling-and-analysis-infrastructure/" rel="nofollow">http:&#x2F;&#x2F;blog.databigbang.com&#x2F;using-queues-in-web-crawling-and...</a>
busteralmost 12 years ago
No Celery, no RabbitMQ, but 0mq, i don&#x27;t know if i should take this seriously..<p>Just putting some google search hits on a dedicated website, aren&#x27;t we?
iamwilalmost 12 years ago
I&#x27;ve always found having to deal with background workers a pain in the butt. Not only do you have to set up additional servers (queue and worker servers), but also you run into problems as a result of your own naivety--such as not using a connection pool for workers so the startup time is too slow, or using a library that doesn&#x27;t handle timeouts. Also, I find that I have little visibility into the queuing throughput, or if I chain jobs for workers (result of one worker goes to another worker), I have no idea if the data made it all the way through.<p>Does anyone else find it a pain, or just me?<p>Also, has anyone ever tried workers as a service, like iron.io? Are there others, and was it worth it?
评论 #6114313 未加载
评论 #6113929 未加载
X4almost 12 years ago
Here are more: <a href="https://en.wikipedia.org/wiki/Message_queue#See_also" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Message_queue#See_also</a><p><a href="http://web2.uwindsor.ca/math/hlynka/qsoft.html" rel="nofollow">http:&#x2F;&#x2F;web2.uwindsor.ca&#x2F;math&#x2F;hlynka&#x2F;qsoft.html</a><p>Man, wish I had time to help you complete it, I have crawled the web thoroughly harvesting all worthy message queues, but my bookmarks are so unorganized because I used to have all important stuff in Chrome, which really has ZERO support in organizing things. Once you bookmark something, it&#x27;s gone, except it&#x27;s in your bookmark bar.<p>Then I switched to Firefox, which has better support for organizing things, starting with Tab-Groups, Tags for Bookmarks etc. unfortunately it&#x27;s not helping to organize bookmarks too. Importing all chrome bookmarks leaves me with an unmanageable task of sorting things.
评论 #6112520 未加载
mindcrimealmost 12 years ago
What about HornetQ[1]? Qpid[2]? OpenMQ[3]? OpenJMS[4]? JORAM[5]?<p>[1]: <a href="http://www.jboss.org/hornetq" rel="nofollow">http:&#x2F;&#x2F;www.jboss.org&#x2F;hornetq</a><p>[2]: <a href="http://qpid.apache.org/" rel="nofollow">http:&#x2F;&#x2F;qpid.apache.org&#x2F;</a><p>[3]: <a href="http://mq.java.net/" rel="nofollow">http:&#x2F;&#x2F;mq.java.net&#x2F;</a><p>[4]: <a href="http://openjms.sourceforge.net" rel="nofollow">http:&#x2F;&#x2F;openjms.sourceforge.net</a><p>[5]: <a href="http://joram.ow2.org/" rel="nofollow">http:&#x2F;&#x2F;joram.ow2.org&#x2F;</a>
kailuowangalmost 12 years ago
I like the idea of having a page listing all libraries regarding a certain topic. What&#x27;s the advantage of a github + Rails solution has over a wiki page?
评论 #6113338 未加载
brandynwhitealmost 12 years ago
I&#x27;d put redis up there too, with their blocking pop and pub&#x2F;sub it&#x27;s really usable as a queue.
sylvinusalmost 12 years ago
You should add RQ in there! <a href="http://www.slideshare.net/sylvinus/why-and-how-pricing-assistant-migrated-from-celery-to-rq-parispy-2" rel="nofollow">http:&#x2F;&#x2F;www.slideshare.net&#x2F;sylvinus&#x2F;why-and-how-pricing-assis...</a>
wanderralmost 12 years ago
More useful than a comprehensive list of all queuing libraries would be a comparison of the best ones with tl;dr summaries of how each works, pros &amp; cons of each approach, and some consistent benchmarks.
robotmayalmost 12 years ago
I&#x27;ve always liked beanstalkd, unfortunately it still has no authentication support so you&#x27;re unlikely to see it catch on in the PaaS environments any time soon (unless someone hooks SASL into it).
flexdalmost 12 years ago
For this to be useful it really needs to be groupable by programming language.<p>And why it needs it&#x27;s own domain&#x2F;website instead of just a wiki page somewhere I do not understand.
LeafyGreenbriaralmost 12 years ago
Looks like this is getting updated, so... No ActiveMQ?
评论 #6113249 未加载
评论 #6112392 未加载
dmgbrnalmost 12 years ago
I think OP&#x27;s motivation may involve <a href="http://xkcd.com/853" rel="nofollow">http:&#x2F;&#x2F;xkcd.com&#x2F;853</a>.
nmbalmost 12 years ago
no <a href="http://www.celeryproject.org/" rel="nofollow">http:&#x2F;&#x2F;www.celeryproject.org&#x2F;</a>?
评论 #6112333 未加载
评论 #6113828 未加载
juntoalmost 12 years ago
I hate to be the one that says this, but MSMQ is missing.
pedromorganalmost 12 years ago
Doesnt specify which language lib is coded in.