One issue that could arise is that delivery managers could take the worst case estimations as an absolute truth and would think that no task could go over the worst case scenarios. I'm sure there would be a few tasks that would go over and would break planning.

But it could work if people are aware that even worst case estimates are not absolute truths and could go over the limit some times.