TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Improving distributed caching performance and efficiency at Pinterest

42 pointsby jparisealmost 3 years ago

5 comments

myrionalmost 3 years ago
I wish Pinterest were less effective at making google image search useless, not more efficient...
评论 #31966824 未加载
评论 #31966151 未加载
ignoramousalmost 3 years ago
&gt; <i>Today, Pinterest&#x27;s memcached fleet spans over 5000 EC2 instances across a variety of instance types optimized along compute, memory, and storage dimensions. Collectively, the fleet serves up to ~180 million requests per second and ~220 GB&#x2F;s of network throughput over a ~460 TB active in-memory and on-disk dataset, partitioned among ~70 distinct clusters.</i><p>Wow.<p>Assuming $0.09 per GB egress on EC2, that&#x27;s $51,321,600&#x2F;mo. Of course, they must be on some Enterprise plan of some sort, but how much discount must they get to make it affordable?<p>By comparison, 180m requests per second on an &quot;egress-free&quot; serverless compute like Workers would cost $77,760,000&#x2F;mo (assuming 6m per $1) or $233,280,000&#x2F;mo (2m per $1).<p>Cloud is wild.
评论 #31970729 未加载
评论 #31966803 未加载
评论 #31968737 未加载
infocollectoralmost 3 years ago
I do hope Pinterest would fund memcached development going forward, especially the language clients for memcached. I&#x27;ve been using pylibmc to access memcached fast, and that project seems to be almost dead (<a href="https:&#x2F;&#x2F;github.com&#x2F;lericson&#x2F;pylibmc&#x2F;issues" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;lericson&#x2F;pylibmc&#x2F;issues</a>).
评论 #31964893 未加载
mandeepjalmost 3 years ago
&gt; the fleet serves up to ~180 million requests per second<p>For comparison, Google serves about 63k queries per second. I hope there&#x27;s not a typo in the above line in Pinterest&#x27;s blog
评论 #31970811 未加载
评论 #31965610 未加载
评论 #31967124 未加载
评论 #31968964 未加载
评论 #31965554 未加载
hwalmost 3 years ago
Curious on why self hosted MC vs Elasticache MC?
评论 #31969466 未加载