If you are going to use Wordpress, you can host anywhere. I am with Digitalocean, because it's only $5 a month and it seems to have the best documentation for self hosting.

I have heard good things about the Wordpress.com hosting, and they have that Android/Iphone app to blog on the fly.

Wherever you host, Wordpress will have multiple plugins for code highlighting etc, although I haven't tried any yet.