It's like a random walk, basically. Now realize that the photon has something like 700000 kilometers to go and a mean free path in the core in the range of one millimeter or so and it's kind of obvious that this will necessarily take some time.