News for hackers. Stuff that matters.
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by cbarnes99 on Sunday November 15, 2026 @02:39PM (#50509951)
It's the fault of the company that designed the automatic alarm. Not the hotel. But it is accurate to say that the cause of the issue was the outage.
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by 01HNNWZ0MV43FF on Sunday November 15, 2026 @02:48PM (#50510031)
We can assign fault, or we can ask which levers we can pull to make it better:

1. Can there not just be a light / siren right next to the gas sensors? Easy to fix, but it requires hardware changes on-site.

2. Could Microsoft have not had an outage? Hard to fix.

3. Could they use some better notifications systems like idk self-hosted ntfy.sh with a warning if the server goes down? Yes but nobody wants to pay for that.

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by croes on Sunday November 15, 2026 @03:09PM (#50510208)
A light has to be seen, a siren has be heard. I bet email has a better chance of alarming the right person.

And you have to check those lights and sirens that they still work.

Everybody knew email was down.

The real problem is nobody thought of the consequences regarding the alarm system

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by stackskipton on Sunday November 15, 2026 @03:24PM (#50510333)
Generally, for sensitive safety systems like this, Light and Siren are visible to those using the facility. So if problem developed, all patrons would be going "Umm, you know your sauna has flashing red light and siren going off?"

Yes, they still have to work but first off, both of those are extremely reliable systems, alarm circuits have extremely low risk of failure. Second, testing them takes 5 minutes a week/month, press the button, look for flashing light and listen to wailing noise.

It's inexcusable to think that email/slack or whatever is acceptable as anything other than notification system so people not in facility can be notified that alarms are going off.

EDIT: You are defending this setup and I'm not sure why. This seems email only setup seem indefensible.

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by croes on Sunday November 15, 2026 @03:57PM (#50510670)
Because we don’t live in an ideal world.

Testing requires staff and you can be sure those parks are understaffed.

Best thing is to avoid them, next best thing is a cheap solution with low maintenance by the staff to notify as much people as possible.

Email wins.

Not a good solution but the best you will get for the price they are willing to pay

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by ssl-3 on Sunday November 15, 2026 @04:41PM (#50511114)
Things do break, so all alarms need periodic testing, whether they consist of email and/or something else.

Whether it breaks because a relay has corroded due to years of service in a chlorine-enriched environment, or because O365 is down, or because O365 tightened up on DMARC requirements: It needs tested.

And it's not a binary choice. This isn't the World Cup, the Super Bowl, or Highlander. There can be more than one.

The alarm system can wear a belt, and suspenders. It can send emails, and it can flash a bright light, and it can also sound an audible alarm.

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by icehawk on Sunday November 15, 2026 @08:04PM (#50512776)
> A light has to be seen, a siren has be heard.

Curious: what do you think has to be done with an email?

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by sokols on Sunday November 15, 2026 @02:50PM (#50510050)
Well somebody has to sign off the solution, in this case the hotel.
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by buran77 on Sunday November 15, 2026 @02:51PM (#50510060)
> It's the fault of the company that designed the automatic alarm. Not the hotel.

The hotel picked a monitoring solution which relies exclusively on email, or configured it like that. If anything they are absolutely both to blame but for different things. The company for designing a safety related system like this, the hotel for selecting an inadequate solution/configuration thus allowing their guests to be harmed.

> But it is accurate to say that the cause of the issue was the outage

The cause of the issue is the more immediate one - the configuration of the monitoring system. This avoids going up the causality chain to far - shitty coffee caused engineer to take down email system, and such.

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by zardo on Sunday November 15, 2026 @02:57PM (#50510107)
Email going down is the proximate cause. A system configuration relying on a single unreliable communications route is further up the causal chain.
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by buran77 on Sunday November 15, 2026 @05:56PM (#50511778)
Let's not forget that we're talking about people getting hurt in a hotel which has a responsibility towards their guests, that's the core topic here, yes? The most reasonable proximal cause for the people getting hurt is that there was too much chlorine in the water. Because the monitoring system didn't work properly. Because the email failed. Because someone deployed a wrong config on MS's cloud infra. And so on.

As I said, there's plenty of blame to go around as a matter of general principle. But for what happened here the hotel bears the responsibility towards their guests, not the monitoring system developers, not Microsoft.

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by stackskipton on Sunday November 15, 2026 @03:31PM (#50510395)
Agreed, I'm not sure how it's acceptable to say "Email is exclusive option you can have" vs "We can email you when alarm is going off but light/siren will flash and it must be visible to those using the facility"
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by ithkuil on Sunday November 15, 2026 @04:09PM (#50510790)
It would be accurate to call it the proximate cause.

Using the unqualified "cause" is misleading click bait and in some places it could get you sued

Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by spunker540 on Sunday November 15, 2026 @04:30PM (#50510996)
Isn’t the cause whatever sprung a leak in the first place? Ie a faulty pipe or valve?
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by ktm5j on Sunday November 15, 2026 @04:56PM (#50511259)
I feel like there are things we aren't being told here.. what kind of automatic chlorine dosing system both knows that there's too much chlorine and continues to add enough chlorine to the point of being harmful. Something is fishy here...
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by mmoll on Monday November 16, 2026 @01:55AM (#50514805)
The control loop probably used email for messaging.
Re:Microsoft 365 outage leads to chlorine gas poisoning of 1... by Dylan16807 on Sunday November 15, 2026 @07:29PM (#50512501)
It's not the alarm that was dumping in dangerous levels of chlorine. Microsoft is in the line of causes to the lack of warning, but not the actual poisonous conditions.