Sure, if you can identify the location of the hardware and you happen to be a sovereign nation that can field the matériel required, who also doesn't have a problem instigating an international incident.
Now, if you're a single entity or a cartel of entities with the financial and technical resources to launch a majority of hash rate attack, you'll have considered what vectors a counter-attacker would attempt to come at you with.
For example, I expect the (simplistic) response to the hypothetical risk vector of "a physical assault on our mining hardware" to be migrated by distributing hardware across a number of data centers and pooling mining computations. Solved blocks are then propagated to the network through a single, obfuscated network node.