Not sure how well it removes "ehm"s, but I use unsilence[1] a lot for lectures. It removes the silent bits from a video file. It isn't a browser plugin however. You have to download the lecture before converting.

It works quite well in my experience.

[1] https://github.com/lagmoellertim/unsilence