I think the better model for solo passion projects is generally to write your program and declare it "as-is". If people want changes to it, that's what forking is for. If you agree with their changes, you might arrange a pull request but that should be seen more as an exception rather than the rule (for this kind of project). This way the original code evolves in separate branches. Maybe one eventually becomes the de facto source, but being the original creator of the project should confer no automatic responsibility.
One very successful example of this in the wild is the open-source roguelike Cataclysm: Dark Days Ahead. Whales wrote the original Cataclysm but ended development of it in 2012, at which point the community forked it and kept development going for the past 8 years so far.
It seems a lot of this recent commotion around OSS is coming from people who feel they are entitled to get paid for doing unfulfilling work, but they want to keep prestige that comes from having their name attached to it. Open source as a job is a privilege, not a career move. Commercial software hasn't gone away.
It felt really nice to have a sphere of software development not tied directly to capitalism for once, but welp, too late now. I guess that's the idealistic part.
PS: you do have a point that it's all in your head: in many ways open source work is addictive! Time for an Anonymous Open Source Developers group.
But indeed, maybe our common conclusion is that open source is not for everybody and it should have a warning on the box like cigarettes.
Well yes, you can. But I think most people feel obliged to respond to feedback, and in fact probably want to respond.
Perhaps it's different for mature projects, but my personal projects are a source of perpetual disappointment.
Too much to do, not enough time.
At the beginning, you have a problem and you try to solve it yourself. If you succeed in doing so, great! Job done. The project is already successful at this point.
Next, you can take the extra step of open-sourcing it, because it might be useful for others too, and you might maybe benefit from the improvements, bug fixes or bug reports of others.
But if you start spending more time on dealing with emails, PRs etc. and it's no fun, just say no. Ignore people calling you "unprofessional" and whatnot. You owe them nothing.
And in fact this step seems to generate most of the bug reports - you get "please implement feature X" and "does this have feature Y?" and so on, from people who have used your software for all of 5 minutes (or not at all).
It's only after a lot of time is wasted that a new project is started. Alternatively, it could be that the people who try to use/reuse software and the people who write new software are completely separate, so that no amount of bug tracker work will lead to new source contributions.
It's also quite idealistic.
For other people open source might start as a desire for better software or just a desire to help but then it doesn't play out the same way. The project doesn't have as much success, the effort is high and the positive feedback low, the user demands or costs unreasonable. Then you draw a line and realise you just created yourself a sort of unpaid internship position where the globe is your boss.
Having experienced something like this my conclusion is that open source in any continuous form is to be seriously avoided.