Actual serious consequences is a big part of what drives people to view sex as very serious business. Most people are happy to see it as just another form of play time if you can nix the threat of death, maiming and babies with a fairly high degree of confidence.
So we have both psychological and physiological causes of not being able to maintain a good "IRL" sexual performance due to a history of excessive and, perhaps at least as important, different stimuli. BUT... The brain can usually easily be retrained if you abstain from those practices. It may take a month or even two, but following this, restore regular dopamine levels when aroused IRL, restore sensitivity, and so on. I see no reason sexbots will be any different.
So I think sexbots will just be a new means that may cause old problems. But also as usual, the more you do things in moderation, the less of a problem they'll probably be. Sure, the old problem with addiction may rear its head again especially among people prone to getting addicted of sex, gambling, alcohol, etc, but I think this is as usual not the problem of a product, but of a personality. The best solution to that is not to withdraw products, but to learn about your addictive personality and take note when you're developing dangerous patterns or perhaps best of all just avoid risking it altogether by steering clear of risky products.
The same thing that happens when young men discover that young women aren't as compliant with their sexual desires as is their hand and or sock, or if you are really advanced a microwaved melon.
Also I think it's a bit silly to focus on men only, especially considering that the sex toy industry pretty much exclusively was focused on women. Sex toys for men only started to really come out less than a decade ago (e.g. Flesh light), vibrators have been around since the 1930's, and dildo's have been around since we learned how to carve bone.
Potential built-in population limiter?
Also, once perfect sex bots become The Norm, there will be people who fetishize actual sweat, imperfections, etc. Real Sex will become some new way to Get Your Freak On.
Human sexuality is surprisingly malleable and adaptable. Otherwise we wouldn't have the problem you are currently decrying.
It is potentially harmful to the possibility of having a real and satisfactory relationship to another living, breathing human being. But I think that actual relationships are so often seriously problematic that the practice of defaulting to them is largely dependent upon there being no other viable options. Historically, women being financially dependent upon men is a big part of why women put up with men at all. As women move into the work force and can support themselves, this raises the bar on what they expect from a man in a relationship. Having sex bot options is better than having no options.
Please note I say this as someone who really likes men, a lot more than many women seem to. But I have been alone for over 11 years in part because I am determined to never again be financially dependent upon a man. I view it as a deal with the devil. It made sense for purposes of raising kids, but it did terrible things to my life and to my relationship to my husband and I am unwilling to live that way again. The default societal expectations for what a woman should put up with are pretty unappealing.
Society is changing on multiple fronts, not just this one. Those changes are going to go forward with or without sex bots. Many of those changes are going to undermine our historical expectations for what sex and relationships are all about. This is already occurring in ways that many people fail to recognize because so many people have so little understanding of what life was like for the common man prior to their own firsthand experiences. But these changes shall march on anyway. In fact, these changes may be part of what is driving interest in and demand for other options where you do not have to put up with someone else in order to get your sexual needs met.
How you first learn about sex affects how you treat other human beings -- including as mere rape targets for example...
https://www.psychologytoday.com/blog/tech-support/201407/wha...
http://www.menshealth.com/sex-women/porn-debate
http://www.huffingtonpost.com/stephen-arterburn/sexually-inc...
and so on.
To pick a random example, lets say that someone's first experience of playing football is from a video game. They may end up with a "warped perspective" of what the game is like to play in reality. But is that a damaging and harmful thing? I don't think so. And I don't see why sex should be treated much differently than any other activity.