How do you put anything that requires storing of something remotely secret on a general purpose hardware ran by untrusted parties?

Simple, you don't. Not every application has secrets that need to be stored on someone else's computer.