TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Former Tesla Programmer's anecdotes about problems

22 pointsby singemonkeyover 4 years ago

3 comments

ckdarbyover 4 years ago
Sounds like every company for those who have spent time in the software world at a large enough company.<p>Example of some of the stuff I&#x27;ve seen at various places:<p>- Team A self ddos Team B taking down a critical platform that stopped the entire company from processing orders.<p>- Bug lead to everyone&#x27;s password being reset to QA value and restoring backups would have taken too long. Any customer who complained about access was told support had reset their password just now to test123 but in reality every customer&#x27;s password had been reset to that.<p>- Another scenario where some QA values got ran on a production environment and some settings and configs had to be manually restored as it was a third party service it got applied against. Halted nearly whole company.<p>- Bug miscalculates how to charge users and basically drains most people&#x27;s bank accounts.<p>- Accidental DNS rebinding exposing CDN traffic to another company and took them down.<p>- Dev mistake bypassing a endpoints on the CDN for caching and throttling rules. Nearly $1M mistake before anyone even noticed.<p>- Accidentally using another S3 bucket template for another S3 bucket and not noticing it had versioning on. Program that dumped it&#x27;s state for restoring to this versioning bucket had +450TB of state versioned. It didn&#x27;t care about the history of state just the present state for restoring. Noticed only by mistake when cleaning up somethings.<p>And many other stories, things happen, you learn, you improve and it is really a risk vs reward calculation on the business side.
maxekmanover 4 years ago
Note that the post is 2 years old. Much may have (and probably has) changed since then. I’m not sure why this is relevant to post now?
评论 #25009537 未加载
评论 #25008738 未加载
yitchelleover 4 years ago
Apart of reddit, I remember a site where all these horror stories were submitted (anonymously of course) and published.<p>Kinda like Wikileaks for horror tech stories. Anyone remember it?
评论 #25009774 未加载
评论 #25008962 未加载
评论 #25011277 未加载
评论 #25008927 未加载