It depends on you and your school. I carried about a semester worth of AP credits so I had an easy time taking all of the courses for both Physics and Math, the overlap between CS and Math was about the same.

As for the PhD, who knows? After four years of undergrad school you could spend 6-9 years in graduate school. A lot can happen between now and then.