Google App Engine: Post-mortem for February 24th, 2010 outage

Original post here: <a href="http://news.ycombinator.com/item?id=1168493" rel="nofollow">http://news.ycombinator.com/item?id=1168493</a>

A pretty good write-up about what went wrong. I like the mitigation procedure of implementing recovery drills that "include the rare and complicated procedures"... whoever runs that is going to have a wickedly fun job!