The stars that make the elements we need form and blow up in only a few million years. A billion years is plenty of time, once you get the hydrogen gathered together enough to get things started.