They're just very different. 4 is as much a tactics game as an RPG.
All D&D versions seem pretty great. I've played the 2.5e CRPGs (fun!), classic Pathfinder (basically 3.5+ - also fun!), 4e RPG, miniatures game, boardgames (all definitely fun!), and lots of 5e (also very fun!) The classic rulebooks are baroque, fascinating, and immensely charming. The settings (Forgotten Realms etc.) are brilliant.
I don't mean role playing a flawed character for story flavor, but that in 3.5e it's way too easy to accidentally make a non viable build that's drastically weaker than other party members (and level appropriate enemies).
5e is more similar to a simplified 3.5e with a little less complexity. And rather than focusing on the tactical turn based combat of the 4e (which was often kind a drag to execute without digital DM aids and digital tabletops), they shifted the focus more to storytelling and player involvement. It was the right move, IMO, for a tabletop role playing game.
On the other hand, I don't think the 5e rules translate as well to computer RPGs. BG3 shines for its exceptional narrative freedom, but its combat is lackluster compared to Temple of Elemental Evil or even Nwverwinter Nights or KotoR, which all used 3E/3.5E to allow really cool build diversity.
Every character class was practically the same with the same mechanics (at will "spells", per encounter "spells", per long rest "spells") and a massive amount of repetition across abilities. As a DM, I was an over worked CPU; monsters were boring and scripted and every character class had liberal amounts of "force the monster to do x" actions that resulted in monsters having little to no agency.
I ran a few adventures in 4.0 and put the books away forever.
Wizards of the Coast did a great job with the balance of customization vs simplicity of 5e and that's why DnD did so well recently. But the alternatives always were there.
Its a big community of literal house-rule makers (everyone plays DnD with their own houserules). Its a community used to making rules for themselves, buying 3rd party rules packages or discussing balance things online. The community will figure something out one way or the other.