News for hackers. Stuff that matters.
Re:Fire declared in OVH SBG2 datacentre building by nikanj on Wednesday March 10, 2021 @02:41AM (#26408841)
According to the official status page, the whole datacenter is still green http://status.ovh.com/vms/index_sbg2.html
Re:Fire declared in OVH SBG2 datacentre building by tweetle_beetle on Wednesday March 10, 2021 @04:38AM (#26409516)
I feel like there should be place to report infrastructure suppliers with misleading status pages, some kind of crowdsourced database. Without this information, you only find out that they are misleading when something goes very wrong.

At best you might be missing out on some SLA refunds, but at worst it could be disasterous for a business. I've been on the wrong side of a update-by-hand status system from a hosting provider before and it wasn't fun.

Re:Fire declared in OVH SBG2 datacentre building by globular-toast on Wednesday March 10, 2021 @10:05AM (#26411935)
Who monitors the monitors?

Agreed, though. A fake status page is worse than no status page. I don't mind if the status page states that it's manually updated every few hours as long as it's honest. But don't make it look like it's automated when it's not.

Re:Fire declared in OVH SBG2 datacentre building by vntok on Wednesday March 10, 2021 @05:31AM (#26409829)
Re:Fire declared in OVH SBG2 datacentre building by hedora on Wednesday March 10, 2021 @09:33AM (#26411584)
Wtf is this disclaimer on Down Detector for? (Navigate to OVH page.). It sits in front of user comments, I think:

> Unable to display this content to due missing consent. By law, we are required to ask your consent to show the content that is normally displayed here.

Re:Fire declared in OVH SBG2 datacentre building by Symbiote on Wednesday March 10, 2021 @10:16AM (#26412075)
It's a Disqus widget. If you denied consent for third party tracking, they can't load it.

I've usually seen this with embedded videos rather than comments.

Re:Fire declared in OVH SBG2 datacentre building by tweetle_beetle on Wednesday March 10, 2021 @06:39AM (#26410216)
Thanks, can't belive it's taken me 8 years to learn about that.
Re:Fire declared in OVH SBG2 datacentre building by joshspankit on Wednesday March 10, 2021 @10:00PM (#26419687)
Would a blatantly false status page meet the criteria for false advertising?

My gut says yes.

Re:Fire declared in OVH SBG2 datacentre building by jakub_g on Wednesday March 10, 2021 @06:25AM (#26410138)
Also, 3 years ago they had an outage in Strasbourg, and the status page was down apparently as a result of the outage.

https://news.ycombinator.com/item?id=15661218

They are not the only ones though. All too common. Well, it's tricky to set this up properly. The only proper way would be to use external infra for the status page.

Re:Fire declared in OVH SBG2 datacentre building by kalleboo on Wednesday March 10, 2021 @07:53AM (#26410718)
It's not difficult to make a status page with minimal false negatives. Throw up a server on another host that shows red when it doesn't get a heartbeat. But then instead you end up with false positives. And people will use false positives against you to claim refunds against your SLA.

So nobody chooses to make an honest status page.

Re:Fire declared in OVH SBG2 datacentre building by toast0 on Wednesday March 10, 2021 @01:24PM (#26414303)
As someone who maintained a status page (poorly), I'm sorry on behalf of all status pages.

But, they're usually manual affairs because sometimes the system is broken even when the healthcheck looks ok, and sometimes writing the healthcheck is tricky, and always you want the status page disconnected from the rest of the system as much as possible.

It is a challenge to get 'update the status page' into the runbook. Especially for runbooks you don't review often (like the one for the building is on fire, probably).

Luckily my status page was not quite public; we could show a note when people were trying to write a customer service email in the app; if you forget to update that, you get more email, but nobody posts the system is down and the status page says everything is ok.

Re:Fire declared in OVH SBG2 datacentre building by jakub_g on Wednesday March 10, 2021 @08:08AM (#26410817)
Yep. I guess what could be done is a two-tiered status page: automated health check which shows "possible outage, we're investigating" and then a manual update (although some would say it looks lame to say "nah, false positive" which is probably why this setup is rare).
Re:Fire declared in OVH SBG2 datacentre building by lebaux on Wednesday March 10, 2021 @07:14AM (#26410410)
Isn’t that why things like statuspage.io exist, though?
Re:Fire declared in OVH SBG2 datacentre building by dolmen on Wednesday March 10, 2021 @08:56AM (#26411218)
Where is statuspage.io hosted?
Re:Fire declared in OVH SBG2 datacentre building by cortesoft on Wednesday March 10, 2021 @11:03AM (#26412627)
I work for a CDN, and we had to change our status page provider once when they became our customer.
Re:Fire declared in OVH SBG2 datacentre building by formerly_proven on Wednesday March 10, 2021 @09:39AM (#26411653)
In the cloud of course. Why do you ask?
Re:Fire declared in OVH SBG2 datacentre building by aetherspawn on Wednesday March 10, 2021 @03:14AM (#26409003)
You're completely right. IMO this is the best comment in this whole thread. Their status page must be broken, or it's a lie.
Re:Fire declared in OVH SBG2 datacentre building by bootloop on Wednesday March 10, 2021 @06:08AM (#26410049)
If there is a SLA with consequences associated with it every status page is going to be a lie.
Re:Fire declared in OVH SBG2 datacentre building by aetherspawn on Wednesday March 10, 2021 @06:25AM (#26410139)
Well, it sucks to catch fire and I care for the employees and the firemen, but if their status page is a lie then I have a whole lot less sympathy for the business. That's shady business and they should feel bad.

I can appreciate an honest mistake though, like the status page server cron is hosted in the same cluster that caught fire and hence it burnt down and can't update the page anymore.

Re:Fire declared in OVH SBG2 datacentre building by Ploskin on Wednesday March 10, 2021 @06:33AM (#26410188)
Is the status page relevant though? At the very least, OVH immediately made a status announcement on their support page and they've been active on Twitter. I don't see anything shady here. From their support page:

> The whole site has been isolated, which impacts all our services on SBG1, SBG2, SBG3 and SBG4. If your production is in Strasbourg, we recommend to activate your Disaster Recovery Plan

What more could you want?

Re:Fire declared in OVH SBG2 datacentre building by PudgePacket on Wednesday March 10, 2021 @07:04AM (#26410364)
> Is the status page relevant though?

What's the point of a status page then if it does not show you the status? I don't want to be chasing down twitter handles and support pages during an outage.

Re:Fire declared in OVH SBG2 datacentre building by Scoundreller on Wednesday March 10, 2021 @05:47PM (#26417466)
Still better than Amazon where their status page describes little and fat chance of anyone official sharing anything on social media either.

I wonder if a server fire would cause Amazon to go to status red. So far anything and everything has fallen under yellow.

Re:Fire declared in OVH SBG2 datacentre building by kahrl on Wednesday March 10, 2021 @11:21AM (#26412855)
To have a status page that reflects actual statuses? To know that I'm not being lied to or taken advantage of? To know that my SLA is being honored?
Re:Fire declared in OVH SBG2 datacentre building by whalesalad on Wednesday March 10, 2021 @08:47AM (#26411129)
lol... that’s how most status pages are
Re:Fire declared in OVH SBG2 datacentre building by kkwtfeliz on Wednesday March 10, 2021 @08:06AM (#26410805)
The weather map is interesting: http://weathermap.ovh.net/

No traffic whatsoever between sbg-g1 and sbg-g2 ant their peers.

Re:Fire declared in OVH SBG2 datacentre building by sgeisler on Wednesday March 10, 2021 @04:53AM (#26409606)
It seems to be a static site, which seems reasonable since it aggregates a lot of data and might encounter high load when something goes wrong, so generating it live without caching is not viable. So maybe the server that normally updates it is down too (not that this would be a good excuse)?
Re:Fire declared in OVH SBG2 datacentre building by keraf on Wednesday March 10, 2021 @05:27AM (#26409810)
10+ hours cache on a status page doesn't look like real-time monitoring to me.

I think this is probably linked to a manual reporting system and they got bigger fish to fry at the moment than updating this status page.

Re:Fire declared in OVH SBG2 datacentre building by sigotirandolas on Wednesday March 10, 2021 @08:16AM (#26410878)
Counterpoint: There's a constantly updating timestamp at the top of the page that suggests it's automated and real time.
Re:Fire declared in OVH SBG2 datacentre building by gpm on Wednesday March 10, 2021 @10:08AM (#26411972)
> Legend: Servers down: 0 1+ 4+ 6+ 8+ 10+ 15+

If they don't have any servers anymore, how can they be down ;)

Re:Fire declared in OVH SBG2 datacentre building by exikyut on Wednesday March 10, 2021 @05:27AM (#26409809)
Re:Fire declared in OVH SBG2 datacentre building by deno on Wednesday March 10, 2021 @03:59AM (#26409293)
Re:Fire declared in OVH SBG2 datacentre building by gadrev on Wednesday March 10, 2021 @06:37PM (#26418051)
Noticed the same this morning, but note they took the link out of the main page (of SBG2 and 3): https://www.ovh.com/world/community/status/

Probably the best they could do at the moment.

Re:Fire declared in OVH SBG2 datacentre building by damsta on Wednesday March 10, 2021 @07:41AM (#26410627)
Four hours later still green.