TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Twemproxy, a Redis/memcached proxy from Twitter with auto-sharding

90 pointsby mjacksonover 12 years ago

5 comments

jaytaylorover 12 years ago
Direct link to github repository: <a href="https://github.com/twitter/twemproxy" rel="nofollow">https://github.com/twitter/twemproxy</a><p>As a sidenote, look at the amount of shenanigans of complexity and redirects in the "github repository link" contained in the article:<p><pre><code> http://links.services.disqus.com/api/click? format=go&#38; key=cfdfcf52dffd0a702a61bad27507376d&#38; loc=http%3A%2F%2Fantirez.com%2Fnews%2F44&#38; subId=804356&#38; v=1&#38; libid=1354646989332&#38; out=https%3A%2F%2Fgithub.com%2Ftwitter%2Ftwemproxy&#38; ref=http%3A%2F%2Fnews.ycombinator.com%2Fnews&#38; title=Twemproxy%2C%20a%20Redis%20proxy%20from%20Twitter%20-%20Antirez%20weblog&#38; txt=https%3A%2F%2Fgithub.com%2Ftwitter%2Ftwemproxy&#38; jsonp=vglnk_jsonp_13546470034491 </code></pre> HOLY MOLY!
评论 #4873877 未加载
mjacksonover 12 years ago
Related: The director of Twitter's Application Services group, Raffi Krikorian, gave an interesting talk about the architecture of Twitter's real-time delivery service at QCon in October. In the talk he discusses in pretty good detail the ways in which Twitter uses Redis to cache copies of users' timelines as tweets are made.<p>Here's a link to a video of the talk: <a href="http://www.infoq.com/presentations/Real-Time-Delivery-Twitter" rel="nofollow">http://www.infoq.com/presentations/Real-Time-Delivery-Twitte...</a>
评论 #4873163 未加载
stock_toasterover 12 years ago
Been using twemproxy with memcache for a while now. It has been great. Damn solid, quality stuff.
druiidover 12 years ago
Well, that's cool and I'm happy to see a library/tool like this being released. I do have an honest question though, in that is this giving much besides what moxi currently is able to do? I use that in a relatively large-scale memcached production environment and have been pretty happy with it. Guess perhaps I'll have to do some digging between the two.
评论 #4874972 未加载
blantonlover 12 years ago
For a second here, I was thinking this was an open source implementation of a decentralized Redis/Memcached store that caches and proxies API queries to the Twitter API - thus possibly presenting an approach to aggregating Twitter API calls and reducing API limit problems for consumers.<p>Sort of a "de-duplication" process for Twitter API calls.<p>But, it's not.