Just as an example of how bad it was before I made these changes, the simple task of unlocking the phone was a nightmare.
I'd be tapping in my code, and it would take a good 10 seconds before -some- of the digits popped up. After doing the spotlight change yesterday afternoon and upgrading overnight, there is no lag unlocking my phone. Some of the apps still load a little slow for my liking, but that urge to slam the phone on the ground and stomp on it has subsided.
I turned off Spotlight for everything except Applications, and I've experienced a slight improvement after rebooting. Since upgrading to 4.0.1 with Spotlight turned off, performance is --much-- better.