Building Resilient Microservices from the Fallacies of Distributed Computing

&quot;Defensive Programming is a well-regarded technique in software engineering.&quot;<p>No.<p>No, it&#x27;s not.<p>Fail early, fail fast, crash loudly, and then react. That, plus deep validation testing, is how you build robust systems. Trying to soldier on when things are wrong just propagates bad data and bad behaviour into a larger surface area that needs cleanup.<p>Assert everything, even in production. Capture all failures and action each one (turn a 500 crash into a validation failure 400, etc)<p>Monitor all logs for unexpected&#x2F;new anomalies.<p>Be vigilant around testing. Failure cases are part of the spec, too!<p>That&#x27;s how robust systems are really built!

I find that microservice is just splitting a problem into multiple small problems while the overhead of fixing each problem is uniform, so you end up with a huge technical debt, and eventually fall into dependency issues.<p>Distributed computing is going to be less efficient than centralized system, now you have multiple vectors susceptible attack...<p>I find the best architecture is a detached standalone-tenancy meaning a copy of the web application distributed as an image running on a different server assets distributed across different web host providers. 1 clone of your app = 1 domain = 1 customer<p>This way DDOS attack requires knowing all of your customer&#x27;s domains which runs your web application, and it dramatically increases the cost of launching a successful and prolonged DDOS attack. The attacker even with a huge bandwidth rate now has to spread it thin across hundreds of your customers website.<p>Sure your own website hosted on amazon s3 could take a hit but your customers are still able to run their business without drama from foreign state actors or xbox players.

The reality of microservices, is that we are all forced to use them whether or not the local app is a monolith. Any app dependent on a 3rd party library (analytics, database, webhook) is typically subject to the article&#x27;s listed network issues. I&#x27;ve seen the issue in 3rd party libraries from each of these categories. So if our app is already architected to defend against errors in 3rd party libs, it&#x27;s not much of a stretch to apply the same techniques to a couple local microservices.<p>As another commenter mentioned, Netflix designed Hystrix to guard against this specific scenario. There are important lessons here regardless of our local app design.