Bizarrely this used to work on Slack, but they removed the feature as part of a fix for some other unspecified notification bug. It’s remained broken since.