News for hackers. Stuff that matters.

A comment on OpenAI's GPT-3 may be the biggest thing since Bitcoin. Parent comment

Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by teruakohatu on Saturday July 18, 2020 @09:03PM (#23886138)
I don't know about GPT-3 but playing around with GPT-2 I often got the impression that it was regurgitating learned knowledge (reddit comments) rather than actually coming up with something novel.

With so many weights, it practically encodes a massive Internet text database.

[ Parent | on HN ]
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by StavrosK on Sunday July 19, 2020 @07:52AM (#23888694)
I had that thought too, and my immediate next thought was that the value isn't in knowing the sentences, but in being able to put them together usefully.
[ Parent | on HN ]
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by Kinrany on Saturday July 18, 2020 @09:23PM (#23886238)
Having a better alternative to search engines would be great.
[ Parent | on HN ]