I've tried doing just that, and it's still somewhat inconvenient. There's quite a bit of stuff that resides somewhere in the $HOME dir, from config to application files. I considered symlinking part of it, but then you have the problem that nothing works without the SSD connected.