AlphaGo Zero was also trained on millions of games, they just weren't games played by human players.