I have never had this problem with Hangouts in Firefox. Hangouts has a million bugs on its own, but it works similarly poorly in Chrome and Firefox and has for a long time as far as I can tell.