Saverin was born in Brazil and has been living in Singapore for a while. There are also probably psychological advantages to being out of Zuckerberg's shadow.

While taxes might have played a role, it's not obvious that this was the principal factor.