If your contact list is small enough to be people that you know well, though, it's not a bad policy. Most scammers are not going to be equipped to imitate my brother's or my wife's voice and mannerisms well enough for me to believe them.