It could be related to previous bad experiences. When I was a teenager, I received bad news via phone call a few times (friend got cancer, other friend was in car accident, etc). It conditioned me to become anxious every time my phone rang.

Of course, I didn't tell people to stop calling me. The problem was my anxiety, not people calling unexpectedly.