This is a bit like the financial crisis in 2008.<p>In 2008, the idea was that if you bundle up a large bunch of mortgages, then the bundle will have low risk because the chances of everything failing at the same time is low. The cloud is designed so that resource usage spikes of individual customers can always be served because one customer is very small compared to the whole infrastructure.<p>However, in some cases, these mortgages/resource spikes become highly correlated.
I think it's very problematic that a major cloud provider is unable to update their status page, even when this has been ongoing for days.
All green ticks here: <a href="https://status.azure.com/en-us/status" rel="nofollow">https://status.azure.com/en-us/status</a>
I heard from an insider that some Azure services had a 10x growth because of the recent changes in our society. It's not like you can prepare for a 10x hit.<p>My personal experience for our AWS CI infra that it's struggling more and more recently. Builds are slower on average than a couple of weeks ago. Maybe those VCPUs are not the same VCPUs as yesterday ;D.
Worked on small Azure setup several weeks ago and probably my experience will be useful for other people:<p>Pro:<p>- you can use shell in browser<p>- traffic is cheaper related to AWS<p>- fast 1GbE network<p>Cons:<p>- VM deploy is VERY slow, 2-3 minutes<p>- no ipv6 out the box, you need a balancer(!) and 4-5 non-trivial shell commands<p>- attaching new storage was extremely painful experience<p>It general Azure feels just like middle cloud service.
Yep, people are finally realizing that 'cloud' isn't something magical and limitless. It's just a bunch of servers, connected together, with each having a limit as to how much data in can store and process.
I think this introduces some interesting points to the DR and BCP conversation.<p>Is it a safe bet that we can rely on the cloud to have capacity? Normally I wouldn't doubt it but in this sort of situation is becomes more likely they will be put under capacity stress.<p>Will the cloud vendors learn and build slack in? I think they're very lean operations and maybe this kind of slack would damage the profitability too much.<p>If the cloud vendors can't guarantee capacity ( I suspect this will be the conclusion ) then what does they mean for our DR and BCP planning?
That's been a recurring issue with the UK South region ever since they introduced it.<p>Theregister even reported on it a couple of years ago<p><a href="https://www.theregister.co.uk/2017/05/04/microsoft_azure_capacity_woes_hit_uk_customers/" rel="nofollow">https://www.theregister.co.uk/2017/05/04/microsoft_azure_cap...</a>
I'm watching many struggle also with on-prem VPNs, Citrix, WebEx, and so on. Though there do seem to be honest efforts to shore those up and also try more modern tools. I imagine a lot of stodgy companies will have a much better WFH environment after all the dust settles.
Disclaimer: I work for Microsoft. I have no particular info on this, but I did read the article _yesterday_ over breakfast, followed links to complaints, etc., and would like to point out two things:<p>1. This appears to be a UK-centric thing (and those datacenters don't have the full Azure portfolio, as can be seen here: <a href="https://azure.microsoft.com/en-us/global-infrastructure/services/?regions=non-regional,united-kingdom-south,united-kingdom-west,europe-north,europe-west&products=virtual-machines" rel="nofollow">https://azure.microsoft.com/en-us/global-infrastructure/serv...</a>)<p>2. The very last paragraph on the linked article reads: "Note that Azure is a huge service and it would be wrong to give disproportionate weight to a small number of reports. Most of Azure seems to be working fine. That said, capacity in the UK regions was showing signs of stress even before the current crisis, so it is not surprising that issues are occurring now."<p>All of this is public info, so maybe people should read up on facts first? :)