News for hackers. Stuff that matters.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by maxander on Saturday July 18, 2020 @09:16PM (#23886208)
I don't think any modern cognitive scientist believes that the statement "language is the stuff of reason," even allowing for poetic flair, is meaningfully true (and I'll leave aside that humans are, obviously, much more than text generation machines.) GPT-3 can generate text but the only context it has is its prompt; when humans generate text they have their complex situation in the world (and perhaps even non-worldly factors, e.g. apprehension of mathematical reality) as context. Fitting the latter kinds of context into AI models is the challenge still facing the path to AGI.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by sooheon on Saturday July 18, 2020 @10:17PM (#23886481)
I agree with you, but also the following is "just" an implementation detail:

> only context it has is its prompt

The only real context is its latent representation of the prompt, there's nothing fundamentally limiting visual, auditory, symbolic, and mixed prompts as long as they map to a common latent space and the generator is trained on it.