It mostly comes down to poor engineering talent, different priorities and leadership that isn't interested in UX. Until recently, adblock, privacy, security and many of the performance trends were just not a big deal. Why fix what's broken when they can double the ads on the page instead?

* I've worked in adtech for years and now currently run my own company where we do this right.