Depends on the age. Above 55 it's indeed quite difficult, under that you can switch back if you fall back into the required status (i.e. take a job with a salary under the limit)