Have you driven a fourth-gen Prius (2016+)? Reviewers seem to agree it has a much nicer feel than previous iterations.
(I own a 2018 and am very happy with it, but I've never driven an older one, so I can't personally address any complaints about driving dynamics.)
My favorite thing about the Prius (other than the economy) is the simply MASSIVE space inside -- particularly rear seat legroom and the flat floor, but the trunk is huge as well.
My least favorite thing is the near-deafening road noise, particularly in the back seat. It's got a tin can door closure sound that reminds me of a Renault 5 or something. It's a HUGE step down from most economy cars in those regards.
This was through the 2nd and 3rd gen, at least. I've not been in a 4th gen.
It's hard to overstate just how weird the driving dynamics of a Prius are. I have a used one from like 8 years ago and going from it to driving a regular car is always a big adjustment because a Prius just doesn't handle like any other car. Solid commuter vehicle either way, though, and I can't complain about the gas mileage!
Now if only people would stop driving their Prius' 10-under in the fast lane.