You can change the search engine in menu -> Settings -> Customise -> Search settings. Is there some other form of unremovable Google integration?
Seems like you can't delete the built-in search providers since the new home screen landed.
Goes off to file a bug...
This bug has existed for a while. It' being worked on, and quite actively this last week.
I could go on and on.