For me it's mostly a few minor UX things, such as not displaying favicons, or how it behaves with a lot of tabs.

Also it's extension ecosystem isn't that great. Stuff like ublock isn't in the official safari extensions page, so you have to go discover it yourself. I can't find a good right click to image search extension either.