News for hackers. Stuff that matters.

A comment on Giving GPT-3 a Turing Test. Parent comment

Re:Giving GPT-3 a Turing Test by freeqaz on Sunday July 19, 2020 @09:57AM (#23889395)
$35-40 an hour is well within the range of a "that sounds fun to grab my friends and mess around with it for a few hours on the weekend" budget!

Especially if you can use spot instances or a cheaper cloud host.

But I guess without the weights, the floor for this is several thousand dollars to play around with.

Do you know if the data set is being released?

[ Parent | on HN ]
Re:Giving GPT-3 a Turing Test by stephenroller on Monday July 20, 2020 @12:26AM (#23894653)
The dataset can be obtained around the web. It's mostly CommonCrawl, Reddit, Toronto Book Corpus, and Wikipedia.

You can find a very comparable corpus open sourced and easy to use on the [T5 repo](https://github.com/google-research/text-to-text-transfer-tra...)

[ Parent | on HN ]