A higher quality USB DAC either has to do quite a bit of signal clean-up, and may use its own power supply rather than trying to clean up the USB power from the computer.
Optical has the benefit of always being electrically isolated.
Optical has the benefit of always being electrically isolated.
So it's the DACs fault, but maybe it's fair to say that it's harder to make a good DAC when USB is how the data is being delivered. I'm sure a high end USB DAC doesn't have this issue, but I'm pretty impressed with my cheap offbrand optical DAC that was $11. I'm guessing I would not be so impressed with the $11 USB version.