https://www.wired.com/2017/05/googles-alphago-levels-board-g...
But then, about a year ago, DeepMind redesigned the system. In essence, they built the new AlphaGo without help from human moves. They trained it entirely from games where the machine plays against itself—part of a continuing progression toward AI techniques that truly learn on their own. “AlphaGo has become its own teacher,” says David Silver, the project’s lead researcher.
Answer: The machines just train themselves.
And that's a good thing. Less work for humans is a great thing, but we have to have new economic models to keep up with it.
When introducing a new ML system, it's generally trained off of people, but in most (though not all) contexts you get much, much more data once the system starts getting used in practice and you get feedback on the decisions that the machine made.
The human knowledge is generally needed as a seed to make the model sufficiently not-bad so that we'd allow it to be widely used in practice and learn on its own.
Who knows? Just because you can't imagine the step after the one I describe doesn't make the one I describe less valid. Maybe it'll become self-improving? We already need AIs to help build CPUs so doesn't seem far-fetched.