As a matter of fact I tried IntelliJ. It was nice, but it had it's own set of problems. Two of them:
- compilation times of bigger Android projects sucks hard. It's just not fast enough. I even feel that using word fast in this sentence is a misuse.
- one of the selling points of the IDE (from their website) is Jabber integration for team coding. Tried for several hours, didn't get it to work. Even filed a ticked for it, which is still unsolved (the package is unmantained for years).
Also, the ADT bundle that Google now has works way better than downloading Eclipse and installing the plugin.
Although, I agree with you, I think Xcode works quite well. But, there are improvements that could be made...