I've been able to make this sleeping pattern work by being in Asia while working with American companies. I reserve 11pm to 3am for meetings/sync with other employees, I work from home and do any work that requires deep concentration in the late afternoon and I reserve lunch plus early afternoon to play with my son.

Luckily my partner is also a night owl and if she weren't forced to wake up early for work would go to sleep around 2-3am. So, when we're on holiday, we're in sync.