If you go straight from undergrad into a PhD track four years is a reasonable minimum, yes. You can at some institutions at least opt to take an MS along the way (as I did) after your two years of graduate level course work is completed, and then continue to complete the PhD.