Page 1 of 1
Anotter update causing chaos
Posted: Fri Jul 19, 2024 1:56 pm
by Lutin
Oops!
Crowdstrike and Microsoft: What we know about global IT outage
A mass IT outage has caused travel chaos around the world, with banking and healthcare services also badly hit.
Many flights have been grounded, with queues and delays at airports.
Cyber-security firm Crowdstrike has admitted that the problem was caused by an update to its Falcon antivirus software, designed to protect Microsoft Windows devices from malicious attacks.
Microsoft has said it is taking "mitigation action" to deal with "the lingering impact" of the outage.
Re: Anotter update causing chaos
Posted: Fri Jul 19, 2024 2:03 pm
by DefTrap
Funnily enough only yesterday I was just rewriting our organisation's Business Continuity Plan and thinking that our reliance on Microsoft for 365 and Azure was overly risky. Not that any of it really deals with these short-term outages, other than waiting it out.
Microsoft wrote:
Microsoft is advising people to try a classic method to get things working - turning it off and on again - in some cases up to 15 times.
Lolz
Certainly a classic.
Re: Anotter update causing chaos
Posted: Fri Jul 19, 2024 2:18 pm
by Horse
Microsoft wrote:
Microsoft is advising people to try a classic method to get things working - turning it off and on again next month - in some cases up to 15 times.
Clarified
Re: Anotter update causing chaos
Posted: Sat Jul 20, 2024 9:03 am
by roadster
One news bulletin did say that safe mode was needed to reverse the update. Makes sense for a security program, you can't just turn it off! Although the platform was Microsoft it was third party software which went wrong. All changes to business critical systems should be tested and approved on mirror systems before role out but it seems that this is not done any more.
Re: Anotter update causing chaos
Posted: Sat Jul 20, 2024 9:21 am
by Mussels
roadster wrote: Sat Jul 20, 2024 9:03 am
One news bulletin did say that safe mode was needed to reverse the update. Makes sense for a security program, you can't just turn it off! Although the platform was Microsoft it was third party software which went wrong. All changes to business critical systems should be tested and approved on mirror systems before role out but it seems that this is not done any more.
There isn't really time for extensive testing on critical security patches, a choice between possible crashes and someone being able to hack your systems.
So when MS started cutting corneres and rolling out standard updates with security ones it was very anoying.
Re: Anotter update causing chaos
Posted: Sat Jul 20, 2024 11:03 am
by Mr. Dazzle
Was chatting to my brother about this yesterday - he's a senior IT security bod for a big ol' company.
He had the server estate all fixed in a matter of a few hours. The ballache is the fact it's a "hands on keyboards" fix, but luckily for him the actual keyboardy people are a few layers down
