Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on EURISKO Lives. Parent comment
>> Do you realize how much more data and compute it would take to train a Vanilla RNN to say GPT-3 level performance?
Oh, good point. And what would GPT-3 do with the typical amount of data used to train an LSTM? Rhetorical.
There are no comments on this comment yet.
>> Do you realize how much more data and compute it would take to train a Vanilla RNN to say GPT-3 level performance?
Oh, good point. And what would GPT-3 do with the typical amount of data used to train an LSTM? Rhetorical.