Re:Tacotron 2: Generating Human-Like Speech from Text
by PeterisP on Wednesday December 20, 2017 @09:20AM
(#15969667)
So, something that easily fits into RAM, One might even keep a copy of the whole dataset in GPU memory to avoid copying to and from even if matrix operations are done on smaller batches.
E.g. ImageNet is 50 gb of compressed data, and there are many much larger datasets in practical use.
For 24 hours that would be 7 mil frames of 80 values ~= 500 mil data points, or 2 GB of raw data (assuming floats)