I had a very beautiful girlfriend during uni + didn't believe this was a problem at all. Then that ended + it became quite obvious.

Just because you managed to overcome the disadvantage, doesn't make it not a thing. It's not all about the attitude (or rather apparent confidence), it's partly about it.