It's not just phase mismatch. There is error in the frequency domain, both from the digital processing going on and the physical characteristics of the driver.