Downvoting my comments does not make them less valid.

You could actually test your hypothesis,make yourself deliberately less desirable, then check the reactions and what that does to your self esteem.

Some anecdotal evidence from a female who wrote a book about it https://en.wikipedia.org/wiki/Self-Made_Man_(book)