I think it helps to define what we are talking about. "Hangouts" can be the system overall, the web interface (and which one, Inbox, Gmail or video chat?), or the mobile phone app, of which it may behavior differently on the different phone OSs. Hangouts is usually very timely and responsive for me when using Inbox or Gmail. The Android app is slow and annoying. I've never used the iOS app.