But before becoming priest there is a quite long training program (often 5-6 years). Dropping out of it is quite common.

And even after becoming a priest, they can asked to be relieved for their obligations, including celibacy. But in this case they would have to find an other job.