Why would the speed of the blog be a problem if it's behind a cache? Just ramp up the ttl entering varnish and purge aggressively on changes; hell, just reboot varnish any time you make a change. Nothing about a cache interface is difficult to work around when your content changes as little as a blog would.
If anything, moving to an unproven blog framework is going to cause much more headaches than a worpress blog slowing down for seconds every time you make a post.
Sounds like "now you have two problems"? There is plenty of blog software out there but very few are so terribly, terribly slow as Wordpress. I'm pretty sure it's the slowest thing I've ever installed on my server (and uninstalled, obviously). Just use something else and there is no need for caching in the first place.