> Large data sets are available on the internets. Something tells me Google may even have access to large quantities of data already.

You don't just need audio data, you also need the correct transcriptions to learn anything from it. This reduces the amount of available data significantly. And producing correct transcriptions is time consuming and expensive.