I personally suspect that removing composite output was the real reason for removing the headphone jack. From what I've read, to enable composite output on the Raspberry Pi 4 you have to enable a special setting on config.txt, which when enabled slows down some of the clocks so that it can produce the correct frequencies for the composite output to work. Not having composite output removes the need for that wart.