The number of people who need to access voicemail from any device except the phone itself is tiny.

Just disallow it by default.

Problem solved.