My father taught me a trick. It's not foolproof, but it's better than your version.

You ask if anyone lost any money. If someone says they did, you follow up with "how much money, and how big were the bills?"

Then they have to know an amount, how many bills, and what denomination.

You can imagine that it's hard to fake, and anyone being genuine will have a pretty good idea of what you're holding.