It's less annoying that getting dozens of spam calls each day. If you will be calling the person frequently, just have them add you as a contact. No big deal.

Not answering unknown numbers not only saves you the trouble of getting them but also results in fewer robocalls over time since you do not answer.