That's just for the training phase. In play mode it only uses 40. And the top supercomputer has 3 million cores, so, AlphaGo is not such a big computer either.