They have zero power, it's just a man with a clipboard asking to have a look around your house, the correct response is to shut the door in their face.

They rely on a uniform and vague threatening language to trick people into thinking they have any authority.