Oracle can't take your cupcake business, but:
- They pay for your mind. That's why the agreement you agree to says, "We own what your mind produces". That's why they hired you.
- In working for them, you get access to tools, knowledge, and experience you wouldn't have otherwise. If you get some great inspiration while talking to the company's client, you're hardly a lone actor.
I don't love it either, but I understand the reasons, and for me it all comes down to how it is enforced. If you develop a web page under Oracle, they shouldn't have rights to that. If you develop an enterprise database that targets Oracle's market segment...
My suggestion: read the contract carefully, make a list of specific questions, and spend an hour talking with a lawyer.
Mine was limited to the company's primary business. Then I asked the founder (of Linode) what "the company's primary business" entailed. He smugly replied "computers."
I'm not saying that the company is right in taking any work you do outside of office hours (I think that's total crap), I'm saying that you've made an agreement and now you're trying to work around it.
In an ideal world, you'd get permission - or work for a company that understands. Of course, the world isn't ideal :)