I don't think it's a USB protocol problem but rather a driver/manufacturer problem.
This may be true but I've never had latency issues with USB soundcards. Right now I have a Line6 Helix Floor unit that I use to play guitar with. I can route the audio through the Helix effects, into Logic and back to Helix for more post-processing and have no latency problems.
I have had other brands and models and none introduced perceivable latency.
I don't use MIDI but I doubt it requires less latency than live guitar playing.
I had a PCIe soundcard a few years ago that made it almost impossible to get rid of ground hum though.
Last time I did audio, installing ASIO4ALL was essential.
Or get an external MIDI clock like the E-RM Multiclock and never bother about MIDI latency issues. Audio is completely fine, 30-50μs of latency won't ever be perceptible to humans, the latency of MIDI will.
In particular, the first readily available set of benchmark results I was able to find[1] suggest the difference in audio (not MIDI) latency between the lowest-latency PCIe cards and the listed USB devices (RME Fireface UFX+ USB3 and RME Babyface Pro [USB2]) is under a millisecond.
While I couldn't find similar results for MIDI I/O, it seems unlikely that either of these USB devices' MIDI interfaces would introduce an order of magnitude more latency than their audio counterparts.
[1] https://gearspace.com/board/showpost.php?p=15796206&postcoun...
https://www.bleepingcomputer.com/news/security/heres-a-list-...
USB can't offer as low latency as a piece of well-designed hardware plugged directly into your PCI bus, at least in my own limited experience. This comes into play when doing music keyboard recording.
eg. I found it difficult to find a USB MIDI adapter that didn't introduce unacceptable latency (when trying to record new tracks synced in real time to existing ones). Edirol was recommended to me but even after tweaking settings for hours it fell short. I wound up buying a second-hand Creative X-Fi Elite Pro PCIe card and love it.