Ah, but you need to compute to make that happen. More compute comes with greater trade-offs in terms of potential side channels to exploit. You're absolutely right.

It's just another step in the arms race ladder.