I'm not misunderstanding anything. I'm simply of the opinion that secure multiuser systems aren't something we can do right now.

Here's just one of the more practical attacks http://palms.ee.princeton.edu/system/files/SP_vfinal.pdf

>but this isn't just any old side-channel attack.

It isn't, but you were already screwed. Now you're just slightly more screwed.