I doubt ULA will exit the launch business in the foreseeable future. Congress will not allow the US to be reliant on a single launcher, and they'll provide enough money to keep Atlas available.

ULA isn't out at least until BO has a few good launches under its belt, which means BE-4 or something similar is reliable.