News for hackers. Stuff that matters.
Re:Natural language generation: The commercial state of the ... by leereeves on Monday January 11, 2021 @08:33AM (#25728628)
Even GPT-3 knows nothing about the real world; it's merely trained to repeat the words that most often followed the prompt in its training data. That's obviously not useful for news...if a fact is in the training data, it's not news. It's not useful for "hard facts about how your pension fund is performing" unless you want to know how it performed a long time ago.

But I agree there are some applications it is useful for, like education.

Re:Natural language generation: The commercial state of the ... by FeepingCreature on Monday January 11, 2021 @08:54AM (#25728854)
> Even GPT-3 knows nothing about the real world; it's merely trained to repeat the words that most often followed the prompt in its training data.

I don't know why that would imply that it knows nothing about the real world, unless the data corpus it is trained on likewise bears no relation to reality...

Re:Natural language generation: The commercial state of the ... by nmfisher on Monday January 11, 2021 @09:26AM (#25729170)
> unless the data corpus it is trained on likewise bears no relation to reality

It’s trained on Reddit, so I wouldn’t rule that out.