Re:Google Open-Sources Trillion-Parameter AI Language Model ...
by dekhn on Wednesday February 17, 2021 @09:00PM
(#26174566)
Google Cloud Storage. The files could be dumped as tfrecord in a bucket with "requester pays". So anybody could reproduce it using the open source code, by paying for the costs incurred to move the data from GCS to the training nodes.
[ Parent
| on HN ]
There are no comments on this comment yet.