One incredibly annoying thing on desktop Linux is losing sound every time I unplug my headphones and plug them back in.

On the other hand, the annoyances from Windows (general sluggishness, pop up advertising, Explorer never remembering how I want things viewed, etc) are now really starting to outweigh the annoyances on Linux, so ultimately I don’t think it matters.