News for hackers. Stuff that matters.
Re:Slack Is Down by 01acheru on Wednesday May 17, 2023 @05:08AM (#35972844)
Another status page that sucks. Slack goes down, people start texting me about it, status page is green, HN informs me that Slack is actually down.

Next time I build a status page it will simply be a static HTML with green indicators and some random metrics, looks like it is the industry standard. :facepalm:

Re:Slack Is Down by viraptor on Wednesday May 17, 2023 @05:47AM (#35973160)
There are two kinds of status pages. Those that show you red when the service is up (automated) and those that show you green when the service is down (manual and automated) - or some mix of those two. You don't want made up information too, so for the manual one you'll get some delay for the analysis of the situation.

Your actions are extremely unlikely to change if the downtime is for less than half an hour. So what exactly do you expect to happen here?

(Yes, I got annoyed at a thousandth comment that essentially says the status update is not instantaneous and perfectly reflecting the situation)

Re:Slack Is Down by ilyt on Wednesday May 17, 2023 @06:20AM (#35973367)
I expect:

* not lying

* not having to dig out our logs and proofs for SLA reasons on obvious fuckup.

> (Yes, I got annoyed at a thousandth comment that essentially says the status update is not instantaneous and perfectly reflecting the situation)

It's not about it being minute behind reality, it's about it lying in entirety. Why you have so much problems with understanding that ?

Re:Slack Is Down by viraptor on Wednesday May 17, 2023 @07:56AM (#35974028)
There's a bit of time between a delayed status report and lying. If you referred to them historically not reporting anything at all then that's fair, but it wasn't clear from the message.

And it's a common comment I see 10min after some service having issues: "the status page is still green" - yes, people are probably still logging in to things and figuring out if the issue actually is internal.

Re:Slack Is Down by ilyt on Thursday May 18, 2023 @06:31PM (#35995107)
But the expectation is that site reports live state.

If it is up to person to change it then it as status page is useless, might as well look at reddit whether people are complaining...

Re:Slack Is Down by switch007 on Wednesday May 17, 2023 @06:10AM (#35973314)
If you accept that status pages are (partially) under the control of PR teams, it makes more sense that they’re useless and a lie.
Re:Slack Is Down by croes on Wednesday May 17, 2023 @06:11AM (#35973315)
Re:Slack Is Down by efficax on Wednesday May 17, 2023 @08:17AM (#35974209)
status pages are rarely automated and it looks like slack was down at like 1am pacific. somebody got woken up by a page and groggily escalated and they sat there fighting the outage for 30 minutes before someone said “what about the status page”. or at least that’s how it worked at my last company
Re:Slack Is Down by stevewodil on Wednesday May 17, 2023 @09:17AM (#35974816)
This is very accurate. Or the customer communication lead was shadowing and this was their first incident.

It’s all the same

Re:Slack Is Down by nurettin on Wednesday May 17, 2023 @08:42AM (#35974452)
Status page pull request is pending merge, because seniors are either fired or or overworked.
Re:Slack Is Down by sjsdaiuasgdia on Wednesday May 17, 2023 @09:07AM (#35974712)
Progression of status pages, from experience at a large cloud provider...

Stage 1: Status is manually set. There may be various metrics around what requires an update, and there may be one or more layers of approval needed.

Problems: Delayed or missed updates. Customers complain that you're not being honest about outages.

Stage 2: Status is automatically set based on the outcome of some monitoring check or functional test.

Problems: Any issue with the system that performs the "up or not?" source of truth test can result in a status change regardless of whether an actual problem exists. "Override automatic status updates" becomes one of the first steps performed during incident response, turning this into "status is manually set, but with extra steps". Customers complain that you're not being honest about outages and latency still sucks.

Stage 3: Status is automatically set based on a consensus of results from tests run from multiple points scattered across the public internet.

Problems: You now have a network of remote nodes to maintain yourself or pay someone else to maintain. The more reliable you want this monitoring to be, the more you need to spend. The cost justification discussions in an enterprise get harder as that cost rises. Meanwhile, many customers continue to say you're not being honest because they can't tell the difference between a local issue and an actual outage. Some customers might notice better alignment between the status page and their experience, but they're content, so they have little motivation to reach out and thank you for the honesty.

Eventually, the monitoring service gets axed because we can just manually update the status page after all.

Stage 4: Status is manually set. There may be various metrics around what requires an update, and there may be one or more layers of approval needed.

Not saying this is a great outcome, but it is an outcome that is understandable given the parameters of the situation.

Re:Slack Is Down by m348e912 on Wednesday May 17, 2023 @05:10AM (#35972853)
https://downdetector.com/status/slack/

Slack is definitely down even though their status page says otherwise.

Incentives matter. If there is no penalty for misrepresenting the current state of an outage, you are going to find that company driven status pages are going to be frequently inaccurate.

Re:Slack Is Down by rozenmd on Wednesday May 17, 2023 @05:24AM (#35972963)
We noticed about 2 minutes of hard downtime (API and website) on OnlineOrNot: https://slack.onlineornot.com/
Re:Slack Is Down by zamnos on Wednesday May 17, 2023 @05:42AM (#35973130)
In fact, there's an inverse incentive at play here. Slack is on the hook for missed SLA, so any admission of issue is legally and financially culpable. This means they don't want to admit to an issue until it's impossible to deny there is one.
Re:Slack Is Down by Hamuko on Wednesday May 17, 2023 @06:27AM (#35973419)
There is also an incentive to display the proper status, since if you show all green when the service is down, you look dumb.

We recently improved our status reporting because our old status system might not accurately indicate if only a part of our service went down, so it might show green even though (some) customers definitely saw very obvious downtime.

Re:Slack Is Down by capableweb on Wednesday May 17, 2023 @06:31AM (#35973441)
When the choice is between temporarily "looking dumb" and permanently loosing a bunch of money because of SLAs, companies like Salesforce usually make the latter choice.
Re:Slack Is Down by Hamuko on Wednesday May 17, 2023 @06:37AM (#35973487)
I feel like customers treating you like a bunch of fucking idiots is not gonna be a great boost to your bottom line either. Maybe if you're in a market sector where reputation doesn't matter and you don't have any competition swooping in.
Re:Slack Is Down by thecopy on Wednesday May 17, 2023 @06:51AM (#35973566)
The people signing the contract with Slack is not looking at the status pages, generally.
Re:Slack Is Down by bombcar on Wednesday May 17, 2023 @08:23AM (#35974258)
The people signing contracts ONLY look at the status page, and say everything’s fine. They don’t bother verifying it signing in.
Re:Slack Is Down by inferiorhuman on Wednesday May 17, 2023 @07:23AM (#35973776)
Nah the issue isn't looking dumb, the issue is looking like a liar. What good is an SLA if your reputation is that you're going to lie to avoid paying out?
Re:Slack Is Down by rwaksmunski on Wednesday May 17, 2023 @08:20AM (#35974230)
This is Salesforce we are talking about. They topped Stack Overflow as the most dreaded technology so they bribed SO not to include them anymore. They don't care if they look like liars to technical people. Technical people are not the decisions makers in their target customer base.
Re:Slack Is Down by Volundr on Wednesday May 17, 2023 @09:25AM (#35974925)
> They topped Stack Overflow as the most dreaded technology so they bribed SO not to include them anymore.

Wait what? And SO agreed? Where can I learn about this?

Re:Slack Is Down by ryanbrunner on Wednesday May 17, 2023 @08:22AM (#35974248)
Usually this is less being outright deceptive (saying you're up when you know you're down), and more wrapping the definition of "down" in legalese so that nothing short of a complete system outage of every aspect of your service for 100% of users counts as "down".

In those cases status pages are more likely to have a lovely spectrum of yellows and oranges to choose from, but a distinct absence of red, but very few companies will say that they're fully green when they know there's issues. Green when you're down is usually more of a symptom of process problems in how outages get reported or resolved (no documentation, manual processes for updating, long communication chains from support teams to engineers).

Re:Slack Is Down by Timon3 on Wednesday May 17, 2023 @06:57AM (#35973600)
> There is also an incentive to display the proper status, since if you show all green when the service is down, you look dumb.

How many customers will think you look dumb? If you admit downtime, will the accurate reporting drive away more new customers, than the inaccurate reporting drives away due to you looking dumb?

"Looking dumb" is not a reasonable factor. Damage to your public image is, but that's divorced from looking dumb. It's entirely possible Slack is saving money by not admitting their downtimes, because it leaves a better image.

Re:Slack Is Down by wdr1 on Wednesday May 17, 2023 @01:03PM (#35978184)
And yet, this generally doesn't happen.

Slack now has the outage listed:

https://status.slack.com/calendar

The online cynicism is something I've never understood. It assumes the world is filled first first-order simpletons & somehow only the poster rises above it.

People aren't dumb & companies aren't dumb. People will notice a status tracker isn't accurate. They will have reduced confidence in the company. Companies know people will notice & think this way, so they generally don't engage in this type of deception. I'm sure there are exceptions, but in general, status pages have tended to be accurate in my experience.

Re:Slack Is Down by zamnos on Wednesday May 17, 2023 @06:40PM (#35982153)
You can't measure "reduced confidence" like you can a dollars going out for not meeting an SLA, and what are you going to do in this case? Move to Microsoft Teams? Please.
Re:Slack Is Down by Chris2048 on Wednesday May 17, 2023 @06:13AM (#35973335)
Their status page is not a report of status, but rather a report of admission.
Re:Slack Is Down by yosito on Wednesday May 17, 2023 @05:38AM (#35973102)
Finally! A chance to get some work done, undisturbed!
Re:Slack Is Down by rohith2506 on Wednesday May 17, 2023 @05:40AM (#35973110)
And yet here we are commenting on HN ;)
Re:Slack Is Down by LtWorf on Wednesday May 17, 2023 @06:19AM (#35973359)
plugging my IRC gateway https://github.com/ltworf/localslackirc

I find that using slack from IRC, and having the option to deprive some people/channels to notify me is very helpful to reduce the amount of distractions.

Re:Slack Is Down by aestetix on Wednesday May 17, 2023 @06:44AM (#35973518)
Nice! How does this compare to wee-slack?
Re:Slack Is Down by LtWorf on Wednesday May 17, 2023 @02:33PM (#35979392)
Well most importantly it lets me use the IRC client I want to use (which isn't weechat), and I can install it via apt.

featurewise I really have no idea. I just use localslackirc.

Re:Slack Is Down by petepete on Wednesday May 17, 2023 @05:29AM (#35973012)
There was definitely a 20 minute window where it was down for us. Messages were occasionally getting through but often in the wrong order, and many just failed.
Re:Slack Is Down by floriangosse on Wednesday May 17, 2023 @06:15AM (#35973341)
Yeah, same for me. Most of the messages I tried to send failed and I had to retry sending them at a later point.
Re:Slack Is Down by floriangosse on Wednesday May 17, 2023 @05:02AM (#35972817)
It seems to be back.
Re:Slack Is Down by a012 on Wednesday May 17, 2023 @04:58AM (#35972779)
The website and app are not accessible (HTTP 503) but their status page is still green :smile:
Re:Slack Is Down by floriangosse on Wednesday May 17, 2023 @04:59AM (#35972786)
Yeah, saw the same. Let's see how long it will take and when they update the status page.
Re:Slack Is Down by antupis on Wednesday May 17, 2023 @05:01AM (#35972802)
Well status pages are nowadays much worse indicator than HN or other sources because companies just don't update those.
Re:Slack Is Down by spuz on Wednesday May 17, 2023 @05:02AM (#35972812)
The post should probably link to the status page (which shows all systems ok at the moment): https://status.slack.com/
Re:Slack Is Down by MollyRealized on Wednesday May 17, 2023 @06:13AM (#35973334)
... or not.
Re:Slack Is Down by swah on Wednesday May 17, 2023 @05:22AM (#35972937)
Working normally for us.
Re:Slack Is Down by yla92 on Wednesday May 17, 2023 @05:01AM (#35972805)
https://status.slack.com/ is not updated yet.
Re:Slack Is Down by miyuru on Wednesday May 17, 2023 @07:49AM (#35973972)
Its been 2 hours and the page still does not show any downtime. Whats the point of having a status page?
Re:Slack Is Down by codetrotter on Wednesday May 17, 2023 @05:25AM (#35972968)
Works fine for me I think
Re:Slack Is Down by 4dregress on Wednesday May 17, 2023 @05:00AM (#35972796)
Yep, its down for me as well.
Re:Slack Is Down by onion2k on Wednesday May 17, 2023 @05:48AM (#35973171)
Based on the notifications I've been getting all morning, I can say for sure it isn't.
Re:Slack Is Down by mastazi on Wednesday May 17, 2023 @05:54AM (#35973215)
Not down for me. OP's link takes me to Slack's homepage.
Re:Slack Is Down by floriangosse on Wednesday May 17, 2023 @06:14AM (#35973338)
I was down at the moment I've posted it. As I wrote in another comment – it's back available for me as well.
Re:Slack Is Down by j4nek on Wednesday May 17, 2023 @05:59AM (#35973247)
productivity for adhd people now increase :)
Re:Slack Is Down by blitzar on Wednesday May 17, 2023 @06:03AM (#35973266)
Working fine for me. I think you might be holding it wrong.
Re:Slack Is Down by floriangosse on Wednesday May 17, 2023 @06:13AM (#35973336)
I was down at the moment I've posted it. As I wrote in another comment – it's back available for me as well.
Re:Slack Is Down by re-thc on Wednesday May 17, 2023 @06:12AM (#35973329)
Slack is just slacking off.
Re:Slack Is Down by floriangosse on Wednesday May 17, 2023 @06:19AM (#35973358)
For those who only rely on Slack's status page here are some other indicators (excl. HN):

* Twitter: https://twitter.com/search?q=%40SlackStatus * Downdetector: https://downdetector.com/status/slack/

Re:Slack Is Down by darkerside on Wednesday May 17, 2023 @06:45AM (#35973522)
Would a decent status page be an actually intelligent use of blockchain? We could have a global network of computers responsible for determining a consensus on whether a service is truly and actually down or not. It could be captured in an independent ledger, and ideally used as a canonical determination for status pages, SLA disputes, etc.
Re:Slack Is Down by stevefan1999 on Wednesday May 17, 2023 @07:42AM (#35973921)
what if the blockchain itself was in an inconsistent state due to 51% attack (also known as split brain consensus)
Re:Slack Is Down by ryanbrunner on Wednesday May 17, 2023 @08:28AM (#35974314)
This is compounded by the fact that there's no objective truth about whether something is down (as evidenced by this thread, outages are often not global or not across the entire service)
Re:Slack Is Down by CPLX on Wednesday May 17, 2023 @07:29AM (#35973817)
The year is 2071.

They built a house of straw. The thundering machines sputtered and stopped. Their leaders talked and talked and talked. But nothing could stem the avalanche. Their world crumbled.

The cities exploded. A whirlwind of looting, a firestorm of fear. Men began to feed on men.

On the roads it was a white line nightmare. Only those mobile enough to scavenge, brutal enough to pillage would survive. The gangs took over the highways, ready to wage war for a tank of juice. And in this maelstrom of decay, ordinary men were battered and smashed.

Except for one man armed with an AK-47, and a Honda full of silver. As he stood on the bluff, looking down at the desert spread for miles before him, a man approached, darkly.

“Instead of silver bars, have you considered blockchain for this?”

Re:Slack Is Down by luplex on Wednesday May 17, 2023 @06:52AM (#35973569)
I think a normal company would be better suited
Re:Slack Is Down by Traubenfuchs on Wednesday May 17, 2023 @07:14AM (#35973722)
You do not need a blockchain for this.
Re:Slack Is Down by ryanbrunner on Wednesday May 17, 2023 @08:27AM (#35974302)
downdetector already does basically this effectively enough and is dramatically simpler in terms of technology. You don't really need to be overly complex about consensus for things like this - if a sufficiently large population reports something down, it's down, because the stakes aren't high enough for enough bad actors to be an issue.
Re:Slack Is Down by ilrwbwrkhv on Wednesday May 17, 2023 @10:08AM (#35975412)
slack is bitchware. a new term i use these days for software which is forced on employees because they have no other option (hence bitches). other examples of bitchware are microsoft teams, jira etc.
Re:Slack Is Down by roofio on Wednesday May 17, 2023 @10:19AM (#35975535)
Could it be that they actually serve a valuable purpose? If they didn't exist would you bitch about email being bitchware?
Re:Slack Is Down by Rafi993 on Wednesday May 17, 2023 @10:13AM (#35975455)
Weird I didn't experience any issues today
Re:Slack Is Down by terom on Wednesday May 17, 2023 @11:12AM (#35976462)
Digging into the status page history reveals a reference to an issue lasting for 7 minutes, caused by a "minor technical change" that was rolled back. [1]

Still claims 100% uptime for May.

https://status.slack.com/2023-05-17

Re:Slack Is Down by Traubenfuchs on Wednesday May 17, 2023 @11:21AM (#35976590)
You are wrong, their status page clearly says

> Uptime for the current quarter:

> 100%