TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Salesforce outage: Global DNS downfall started by an engineer trying a quick fix

35 pointsby etxmalmost 4 years ago

4 comments

Mandatumalmost 4 years ago
&gt; &quot;We&#x27;re not blaming one employee,&quot; said Chief Availability Officer Darryn Dieken<p>&gt; &quot;For whatever reason that we don&#x27;t understand, the employee decided to do a global deployment,&quot; Dieken went on. The usual staggered approach was therefore bypassed.<p>&gt; And the engineer who sidestepped Salesforce&#x27;s carefully crafted policies and took down the platform? &quot;We have taken action with that particular employee,&quot; said Dieken.<p>Holy contradiction, Batman!
评论 #27252480 未加载
评论 #27254558 未加载
justin_oaksalmost 4 years ago
This looks pretty bad on Salesforce&#x27;s engineering culture.<p>1. They&#x27;re still using manual processes where automation should be used.<p>2. They&#x27;re using insufficiently robust scripts (Forgivable to a degree. Bugs happen)<p>3. They blame the individual rather than the process which allowed the individual to make this mistake.<p>4. They have their status page on the same infrastructure that the status page is reporting on.
cratermoonalmost 4 years ago
10:1 some manager or product&#x2F;salesperson told the engineer to rush it.
评论 #27251942 未加载
supergirlalmost 4 years ago
sure, blame it on 1 person. don’t blame the company with such a messed up infra that 1 person can accidentally bring it all down
评论 #27257291 未加载