With a uniform initialization, presumably you'd never need much more than 2^(network bit complexity) number of samples to come across an ideally-initialized network with decent probability, so that's 2^10^24 for anything that fits in a yottabyte.