http://i.imgur.com/2BahpeT.png
I always get Search, Apps and Contacts right away like @dragonwriter.
Honestly no, I don't usually, but that's because I barely have to. I know where all my stuff is and who my contacts are. I use it primarily for Google Search.
The fact you're not using it is the ultimate proof, on iPhone it was super useful. And no way you "know where everything is" I bet you swipe for 30 seconds every time you want to open an app that's not on your home screen...
I'm not sure why it's not working for you but other than being a bit slow to start up (they really should load the keyboard before recent searches) I don't think I've ever had an issue finding what I was looking for.
And no, it does not take me 30 seconds to search for apps. I only have 3 pages of apps, so it takes at most 4 taps. Most of the apps I use regularly are on one of my two main pages though, so I barely even need that many.
Maybe it's saying something that you need 30 seconds to find apps on your phone.