"That's only true if your terms of employment are written with a clause like that."
For many potential investors, that won't be enough. They won't touch you without ironclad assurance of clear ownership of IP.
I stand by my original comment. It doesn't matter who's right or wrong. Can you really afford spending any time in your first 2 years on legal matters regarding IP ownership? Believe me, there are people out there that will do ANYTHING to steal from you. Why tempt them?
Other companies and organizations only care about the work you do while on the job (9-5 or whatever) and theoretically have no legal ground to claim ownership on outside projects provided you never do work on those projects while "on the job." Obviously the word "work" in this context could have many different meanings... (I am not a lawyer)