TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Scaling Reddit from 1 Million to 1 Billion – Pitfalls and Lessons [video]

201 pointsby veszigalmost 12 years ago
Jeremy Edberg shares some of the lessons learned scaling Reddit, advising on pitfalls to avoid.

14 comments

itryalmost 12 years ago
What a horrible website. Made an account to get the mp3. Just to discover that the mp3 download link doesnt work even then. Thank god I used a throwaway email to sign up. Otherwise I would be even more pissed.
评论 #6222915 未加载
russellurestialmost 12 years ago
Disappointment in the HN community has reached a new high today.<p>So, instead of discussing the topics in the video, the majority of commenters here are discussing the flaws of the website it&#x27;s hosted on or debating whether or not reddit is profitable. Neither of which has ANYTHING to do with scaling.<p>I expected better, people. Seriously.
评论 #6224957 未加载
评论 #6225040 未加载
评论 #6226036 未加载
billb2112almost 12 years ago
&quot;ask me anything about running a profitable social media company&quot;.<p>Except for that reddit is not profitable.<p><a href="http://blog.reddit.com/2013/08/reddit-myth-busters_6.html" rel="nofollow">http:&#x2F;&#x2F;blog.reddit.com&#x2F;2013&#x2F;08&#x2F;reddit-myth-busters_6.html</a><p><a href="http://www.reddit.com/r/TheoryOfReddit/comments/1ihwy8/ratheism_and_rpolitics_removed_from_default/cb50c8c" rel="nofollow">http:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;TheoryOfReddit&#x2F;comments&#x2F;1ihwy8&#x2F;rathe...</a>
评论 #6224020 未加载
dapalmost 12 years ago
I was confused about the memcached problem after moving to the cloud. I understand why network latency may have gone from submillisecond to milliseconds, but how could you improve latency by batching requests? Shouldn&#x27;t that improve efficiency, not latency, at the possible <i>expense</i> of latency (since some requests will wait on the client as they get batched)? And while maybe efficiency is valuable, why would that be an improvement for a problem they didn&#x27;t have before?
评论 #6225154 未加载
评论 #6225417 未加载
评论 #6225156 未加载
评论 #6225221 未加载
hardwaresoftonalmost 12 years ago
So did anyone else take the most important lessons in the video as:<p>1. Use AWS<p>2. Use Postgres<p>3. Use AWS<p>4. Use Cassandra<p>5. Use python, so later you can write C when shit needs to go super fast<p>That&#x27;s what I got.
评论 #6226744 未加载
gwu78almost 12 years ago
<a href="http://d1snlc0orfrhj.cloudfront.net/presentations/13-jul-scalingreddit.mp4" rel="nofollow">http:&#x2F;&#x2F;d1snlc0orfrhj.cloudfront.net&#x2F;presentations&#x2F;13-jul-sca...</a>
endlessvoid94almost 12 years ago
Thrilled to finally see this on InfoQ -- already an underappreciated resource for technical talks. What is it about video + slides that appeals so little to people?
评论 #6222821 未加载
评论 #6223541 未加载
评论 #6223366 未加载
评论 #6222797 未加载
评论 #6222872 未加载
评论 #6222945 未加载
评论 #6223021 未加载
vegasjealmost 12 years ago
Does anyone know how the different storage systems are utilized, and why each system is utilized for that purpose? The presenter mentions using memcached, Cassandra, and PostgreSQL, and mentions the same type of data when discussing each (votes, for instance). I would definitely benefit from a more in-depth understanding of how each system is utilized, and why.
评论 #6226879 未加载
heedalmost 12 years ago
Side question: is vote queuing the reason behind the sometimes large drops in score on highly active and popular submissions on reddit?
评论 #6226863 未加载
conradfralmost 12 years ago
I wonder if the demise of Digg three years ago and the (supposedly) inflow of new users have been problematic at the time.
评论 #6226856 未加载
评论 #6226107 未加载
grandpoobahalmost 12 years ago
Reddit still uses Pylons, and I imagine moving to Pyramid would be very painful. He&#x27;s not clear on this in the video.
评论 #6224026 未加载
perlpimpalmost 12 years ago
For me link works only in safari. Firefox plays only video and chrome just does not work.
diminishalmost 12 years ago
I am curious how much a Go lang rewrite would make a difference in scaling up.
评论 #6223650 未加载
评论 #6222900 未加载
OGCalmost 12 years ago
Reddit&#x27;s not profitable though..
评论 #6224029 未加载
评论 #6223354 未加载
评论 #6222968 未加载
评论 #6223107 未加载
评论 #6223170 未加载
评论 #6223267 未加载
评论 #6223350 未加载