Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by ypcx on Saturday July 18, 2020 @10:15PM
(#23886470)
The transformer model as presented in GPT-3 may be a few tweaks away from a human-acceptable reasoning, at which point we may realize that human brain is just a neat party trick as well. This may come difficult for some people to internalize, especially those who understand the technology in depth. Because it means that the medium of our reality is the consciousness.
[ Parent
| on HN ]
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by walleeee on Saturday July 18, 2020 @11:01PM
(#23886683)
Was this comment generated by GPT-3?
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by Naracion on Sunday July 19, 2020 @02:10PM
(#23891168)
I doubted that as well, but I don't think it is--at least it's not a simple copy paste. There's an emphasis on _is_ in the last sentence which I don't think the algorithm could have generated.
However that makes one wonder if it can also learn to generate emphases, and if so, how would it format? With voice generation it can simply change its tonality but with text generation it has to demarcate it in some way--does the human say "format the output for html", for instance?
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by sytelus on Sunday July 19, 2020 @06:38AM
(#23888416)
You are confusing pattern matching with reasoning. If your brain was replaced by GPT-3 model and you were cast away on a distant island, I highly doubt you will be able to perceive, plan and prosper during your survival against all the calamity nature would through at you.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by mamon on Sunday July 19, 2020 @10:08AM
(#23889470)
To be honest, most city-raised humans wouldn't be able to survive on a distant island as well.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by Tarean on Sunday July 19, 2020 @01:42PM
(#23890947)
The transformer model in GPT-3 has a short context window and no recurrence. Without some significant architecture changes that is a fundamental limit on the problems GPT-3 can solve.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by lucidrains on Sunday July 19, 2020 @03:00PM
(#23891532)
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by visarga on Sunday July 19, 2020 @12:07AM
(#23886918)
> Because it means that the medium of our reality is the consciousness.
I agree. The environment - as the source of learning and forming concepts, is the key ingredient of consciousness, not the brain.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by yomly on Saturday July 18, 2020 @10:28PM
(#23886537)
I don't fully understand what you're getting at here...
Basically the brain and "consciousness" isn't as fancy as we think?
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by lucidrains on Sunday July 19, 2020 @03:08AM
(#23887583)
Exactly.