I would spend lot of time talking with different customers and trying to move that into development, but I was losing so much time I could have spent solving serious technical problems.
Having a good product owner that sees the big picture and can write down a rough specification of features would have helped massively and allowed me to do what I do best.
On other hand, I was also in a situation where product owner depended on me to do his work. That is even worse.
To one of the broader points, in both my personal experience and what I see software PMs doing in my current non-PM role, they spend a lot of time talking to customers.
I got to see a broad swath of users with pretty different needs, and learned a lot about how their clinics worked. It was really good for thinking concretely about tradeoffs.