My team mostly works similar hours to me (1-9, as I said elsewhere) but my previous team was more nine-to-fivey. We just had meetings after lunch, it wasn't a big deal. A couple folks on the team had kids and left every day at 5:00, and I did their code reviews in the evenings (so they were ready waiting when they came in the next day), and they did mine in the mornings, and it worked fine.