Set default ring tone to silence. Create separate ring tones for people in a contact list or people for whom you must pick up a phone.

I have been using this for 3 years. No issues at all.