This is my experience as well. Perhaps people use different clients and experience it differently. I use the web client almost exclusively and I often see toxic replies to people I follow or, occasionally, subjects I've engaged with before. It would be worth exploring alternative clients that show me only tweets from people I follow, and hides all responses unless I choose to dig in.