I don't believe they could - the protocol has some mitigations against this including an inactivity/censorship fee that applies equally to every staker.