If you are operating from a place of fact and not opinion, you can also express that by sharing the evidence. Otherwise it's just empty claims on empty claims.

If you want to challenge an empty claim, do it right. Or, don't be a jerk. Either way.