TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Facebook blames a server configuration change for yesterday’s outage

76 pointsby Errorcod3about 6 years ago

12 comments

fenwick67about 6 years ago
To everyone jumping to conclusions, remember that the words "server" and "configuration" can mean a whole host of things. It doesn't necessarily mean they mistyped their nginx config.
评论 #19394358 未加载
mattbeckmanabout 6 years ago
Largely impacted by this outage was how it affected those who use Facebook Login as a convenient OAuth option. Good thing for developers to remember if someone asks them to avoid a native login option.
aboutrubyabout 6 years ago
Not a big surprise as it's one of the harder things to test.
cannedslimeabout 6 years ago
Keep calm and blame dev ops!
mancerayderabout 6 years ago
.. but, but, didn&#x27;t they wring the DevOps folks through coding challenges, sorting algos and whiteboard coding before hiring them? I heard that&#x27;s the number 1 way to ensure uptime at FAANG.<p>(Configuration changes, that&#x27;s the source of my sarcasm)
评论 #19398888 未加载
louskenabout 6 years ago
It took very long to fix so I think this was related to their databases, maybe some data corruption.
CodeSheikhabout 6 years ago
Seems like a lot of people were forced to be productive yesterday (:
评论 #19394705 未加载
评论 #19395087 未加载
rachelbythebayabout 6 years ago
Ah, the tao of reliability.<p>Async too.
chowesabout 6 years ago
Must be related to them merging the chat backends for WhatsApp, FB, and Instagram
评论 #19394967 未加载
ajsharpabout 6 years ago
Also, &#x27;many people had trouble accessing our apps and services&#x27; is some ninja-level gaslighting: <a href="https:&#x2F;&#x2F;twitter.com&#x2F;facebook&#x2F;status&#x2F;1106229690069442560" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;facebook&#x2F;status&#x2F;1106229690069442560</a>
评论 #19395735 未加载
评论 #19394868 未加载
halfnibbleabout 6 years ago
WAT. A server configuration change? What kind of server configuration can affect presumably thousands of machines replicated across the globe? I&#x27;m trying to understand this.
评论 #19394227 未加载
评论 #19393850 未加载
评论 #19394336 未加载
评论 #19393929 未加载
评论 #19391795 未加载
ajsharpabout 6 years ago
This is fucking bananas. For nearly a decade, Facebook has been at the forefront of innovating how code is deployed at global scale. They presumably have gradual rollouts, automated rollbacks, anomaly detection, not to mention (I assume) loads of organizational safeguards in place to ensure this sort of thing never happens.<p>Something else happened. This was not a configuration issue. Edit: If it was, I&#x27;d expect a post-mortem post-haste.
评论 #19394210 未加载
评论 #19394682 未加载
评论 #19394791 未加载
评论 #19394977 未加载
评论 #19394294 未加载
评论 #19394071 未加载
评论 #19394373 未加载