I've got portable speakers that sound absolutely terrible when actively charging. Do you reckon this would help?

Ground loops are very odd phenomena that can be hard to debug, but it will probably work.

(The stupid option is to lift the ground on your mains adapter, but you really shouldn't do that, somebody might get killed.)