Hanzi is necessary because there are many regional dialects with significantly different pronunciation (and thus different pinyin, or even none), but mostly the same spelling.

It takes a while to learn for sure, but it's not that hard. The relationship between the written and spoken language isn't that much worse than in English. And at least the grammar is trivial.