Don't know about UK, but in Canada one can stop paying taxes once all "domestic ties" are severed. This means closing all bank accounts, disconnecting all phones and selling the car and the real estate (or alternatively leasing it out for a long term). Even after all this is done, the tax agency (CRA) will not assume you to be a non-resident if you do not stay out of the country for at least 2 years. So it is a hassle. Can't just lock the house, hop on the plane and spend a year travelling.

Btw, the best thing to do for you at this point would be to talk to the tax planning advisor. Pick a big accounting firm with lots of experience and in one hour you will know if you want to do I or not.