I can recommend USB speaker phones/headsets like the Jabra Speak series. Anker recently released their own series as well and there's also beyerdynamic phonum. The big benefit is that noise cancellation is builtin and USB sound is sufficiently standardized that there shouldn't be any issues.

Though I went to the trouble recently to configure builtin pulseaudio noise cancellation and got quite good results as well.