But as counter-examples I submit J. G. Ballard, Samuel Delaney, Ursula LeGuin, John Crowley, Gene Wolfe, William Gibson, Harlan Ellison, Ray Bradbury, and Theodore Sturgeon — and there are surely others I'm forgetting. All great prose stylists, all masters of characterization, and arguably among the greats of the genre.
You can get all sorts of combinations of various attributes, but you just can't get them all. Certainly Egan is in the Silver Age Asimov/Clarke tradition of sacrificing characters to fit the rest in, but what he does is so good I can't complain. For all the crazy science fiction I've read, Egan has, just to name one example, the only story set in a serious attempt at an alternative space-time geometry in which there are two space and two time dimensions, and not in some vague what-if "parallel dimension" sense, but by actually working out the consequences of what two spatial and two temporal dimensions looks like when you feed that into the equations of general relativity: https://www.gregegan.net/DICHRONAUTS/00/DPDM.html
(I find this one particularly interesting because many of us have imagined "what if there were two time dimensions"; Egan shows that what came to most of our imaginations was so laughably wrong as to not even be in the ballpark, and that in fact you can perfectly sensible discuss the topic grounded in real physics.)
Even in the field of science fiction writers there's only a certain percentage of writers who could even properly follow that page, let alone generate it themselves.
'Nuff said.
Joe Haldeman's non-SF novels were all very good in their way. I wonder if he would have been happy to make the switch to full time non-genre writing if 1968 (his Vietnam novel - although he'd joke that all his novels are Vietnam novels) hadn't fizzled. I'm not the right person to criticize his poetry, but I enjoyed some of it.
As some others mentioned, Iain Banks, Ursula LeGuin, and William Gibson wrote some great non-genre stuff. In a different world William Gibson could have been a great essayist in the vein of John McPhee.