Remember it’s not a normal social interaction. They use the fact that it feels rude to refuse to answer questions to get you to incriminate yourself. They’re playing a game, and so you need to understand the rules. Not answering is not being rude. Invoke your 5th amendment right and shut up.