Indeed, best advice I can give for people having trouble is: do anything you need to do to survive Act 1 and kill 2-3 elites. After that you've got a lot more flexibility.