TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Migrating Messenger storage to optimize performance

104 pointsby tagxalmost 7 years ago

7 comments

oerplialmost 7 years ago
They say that they brought some new search features to mobile, though I would prefer if they fixed their search on desktop (or in general) first, as it only returns results from recent messages.<p>Until sometime in 2016&#x2F;2017 it was possible to look for specific things at whatever time (e.g. 2011) and now even things from &lt;3y ago don&#x27;t return anything.
评论 #17403226 未加载
评论 #17405539 未加载
dingo_batalmost 7 years ago
Whatever you may think of social networking, Facebook takes huge amount of pains to ensure reliability. They moved all the data from spinning disks to flash, also migrating to a new db. No downtime at all.<p>I&#x27;m a bit unclear as to how this process resulted in 90% decreased storage use.
评论 #17405380 未加载
nemothekidalmost 7 years ago
Facebook has been using RocksDB more and more (now messenger, but also Instragram’s flavor of Cassandra). I wonder if Google has a similar penetration of LevelDB (and we just don’t hear about it because Google’s infrastructure work isn’t open source)
评论 #17411300 未加载
评论 #17404893 未加载
Zaheeralmost 7 years ago
During the dual-write phase, what happens if one request succeeds while the other doesn&#x27;t?
评论 #17405756 未加载
bigatoalmost 7 years ago
What about giving me an easy option to export my messages while you are at it?
评论 #17402916 未加载
评论 #17402910 未加载
tomnipotentalmost 7 years ago
TL;DR - Moved from HBase to MyRocks engine on MySQL sitting on top of NVMe storage via their Lightning Server [1], which is a JBOF (just a bunch of flash) setup using x16 PCIe.<p>[1] <a href="https:&#x2F;&#x2F;code.facebook.com&#x2F;posts&#x2F;989638804458007&#x2F;introducing-lightning-a-flexible-nvme-jbof&#x2F;" rel="nofollow">https:&#x2F;&#x2F;code.facebook.com&#x2F;posts&#x2F;989638804458007&#x2F;introducing-...</a>
评论 #17404796 未加载
评论 #17402638 未加载
评论 #17403014 未加载
philip1209almost 7 years ago
Great, now they can serve video ads in Messenger more easily.
评论 #17403473 未加载