Basically there are three classes of people: Those who need public insurance, those that need private insurance, and those that can choose between them. Who is in which class depends on many factors such as your type of work, income, and insurance history both in Germany and abroad. It does however not dependent on your citizenship or immigration status.