In my experience "right away" has a significant amount of flex to it. I've started new jobs anywhere from 2-6 weeks after getting an offer, with no problems or pushback whatsoever.