If that would be "crazy" then I don't really see why you're so enthusiastic about using the same key for these "different" accounts.

I get how you can make it arguably safe, but it just seems like a needless risk exactly like a single shared account.