> But physically access a single device in order to make brute-forcing it possible, that seems acceptable to me as that won't affect any other device.

Sure, they can try brute-forceing it, or even break open the chips and try to extract keys with an electron microscope. That's all within their domain. But why should anyone be forced to assist them?