My worry about doing this is that I'll be put on some "answers the phone" list that subjects me to further robocalls down the line, whereas if I don't pick up my number may be seen as less valuable.