Include to favorites
“Has any one began getting discussions with their CIO/CEO about relocating back again to an in-dwelling mail server? I advocate for it”
Offered the scale of its person base and with a agreement really worth up to $10 billion in the bag to run the back again-close of a superpower’s navy, Microsoft may possibly want to begin imagining about how it can set up a staging procedure for its Azure cloud that lets it to deploy alterations and reliably roll back again those alterations when points break.
(We know, it is quick to say so from a safe and sound distance…)
Redmond was at it yet again late Monday, knocking an (evidently substantial) “subset of customers in the Azure General public and Azure Governing administration clouds” offline for 3 hrs with swathes of people globally encountering mistakes accomplishing authentication operations various expert services have been impacted, which include Microsoft 365.
The enterprise blamed the situation on a “recent configuration modify [that] impacted a backend storage layer, which brought about latency to authentication requests.” (Read through, people could not login to Teams, Azure and far more for hrs due to the fact of the snafu).
A entire root bring about assessment is pending. (We will update this piece when we see it). The blockage was felt for people from 22:25 BST on Sep 28 2020 to 01:23 BST.
The situation arrives a fortnight following a protracted outage in Microsoft’s British isles South region induced by a cooling system failure in a details centre. With temperatures climbing, automatic techniques shut down all community, compute, and storage resources “to defend details durability” as engineers rushed to just take manual manage.
Before this month in the meantime Gartner reported it “continues to have considerations related to the total architecture and implementation of Azure, regardless of resilience-concentrated engineering endeavours and enhanced provider availability metrics during the previous year”.
Microsoft Azure CTO Mark Russinovich in July 2019 reported that Azure experienced formed a new High quality Engineering crew within just his CTO office, doing work along with Microsoft’s Internet site Reliability Engineering (SRE) crew to “pioneer new ways to deliver an even far more dependable platform” pursuing buyer issue at a string of outages.
He wrote at the time: “Outages and other provider incidents are a challenge for all general public cloud providers, and we proceed to improve our knowing of the complicated approaches in which components this sort of as operational procedures, architectural types, components troubles, computer software flaws, and human components can align to bring about provider incidents.
“Has any one began getting discussions with their CIO/CEO about relocating back again to an in-dwelling mail server? I advocate for it” just one pissed off person observed on a worldwide Outages mailing listing meanwhile… If cloud is your compressed audio stream that you are not absolutely sure you possess, it could not be very long just before in-dwelling mail servers turn into the classic top quality vinyl of the IT environment old, but pretty a great deal back again in need.
Stranger points have transpired.
