TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Comparing Message Queue Architectures on AWS

87 pointsby itaifrenkelover 10 years ago

8 comments

yashinovskyover 10 years ago
Have you also evaluated Kafka? as it is a common choice feeding Storm .
评论 #8942124 未加载
评论 #8942442 未加载
评论 #8941753 未加载
jedbergover 10 years ago
The first architecture using two ELBs has a long list of cons, most of which are solved by using HAProxy as your internal load balancer. May want to considering adding that as another option on the matrix.
评论 #8942137 未加载
tylertreatover 10 years ago
Really nice write up. I&#x27;m curious if you guys have done any extensive throughput and latency benchmarking? I saw the note saying &quot;ballpark figures.&quot;<p>FWIW, I&#x27;ve been working on a framework for empirically testing queue performance for scaled-up, distributed deployments (<a href="https://github.com/tylertreat/Flotilla" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;tylertreat&#x2F;Flotilla</a>). Haven&#x27;t gotten around to adding support for AWS services yet, but would be interesting to see how they compare.
评论 #8940919 未加载
评论 #8940938 未加载
itaifrenkelover 10 years ago
OP here... I would be happy to discuss any comments you have.
评论 #8940757 未加载
评论 #8940707 未加载
评论 #8942471 未加载
评论 #8940925 未加载
jpp123over 10 years ago
Out of curiosity did you look at gearman? I really like the ability to coalesce identical jobs.
评论 #8942200 未加载
omniover 10 years ago
You give Redis a yellow rating on prioritization, noting that this can be partially achieved using multiple lists. Wouldn&#x27;t it be much better to take advantage of Redis&#x27;s sorted set type?
评论 #8944457 未加载
threeseedover 10 years ago
Surprised they didn&#x27;t mention IronMQ: <a href="http://www.iron.io/mq" rel="nofollow">http:&#x2F;&#x2F;www.iron.io&#x2F;mq</a><p>It&#x27;s not perfect but pretty damn close. And it run on AWS et al.
评论 #8942133 未加载
kondroover 10 years ago
I&#x27;m surprised that SNS wasn&#x27;t mentioned here, being an AWS queueing product.
评论 #8942333 未加载