Well, yea. In training, AlphaGo played against itself, and lost every one of those games. (Incidentally, it also won every one.)
But if we make a general purpose AI that can adapt against any discovered winning strategies instead of falling into repeatedly losing, it won't be our equal. It will have surpassed us.
We have squishier heuristics for what "winning" is compared to AlphaGo, and that seems likely to stay true for the foreseeable future of specialized AIs. But someday it might not.
It can also let the experimenting to its opponents and learn from that. That largely is what humans do, too. Generals plan for the last war, and the students who aren't challenged tend to learn badly or not at all.
And, apparently, the Google AI for go would learn from losing games. Whether it would learn enough to eventually beat (or at least tie) every possible strategy thrown at it, afaik is an open question.
For the AI to really be the best, it must sometimes lose because it's trying a new strategy and experimenting. It also must be robust and find the error of its way easily -- in other words, know quickly that it's being gamed.
AI must be able to reprogram itself, or it's only a matter of time before a winning strategy comes out against it. If it can't reprogram itself and evolve without humans is it really AI?