Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by the_other on Sunday July 19, 2020 @05:53AM
(#23888228)
I’ve not studied neural nets and ML since undergrad level in 1998. So I am almost as knowledgeable as a random person on the street.
The quality of writing was very high, so I was convinced I was reading something put together by a human with agency... except it didn’t pass my gut-feeling “how IT works”. It made me suspect that either the algorithm (the described one, not the AI responsible) was off, or that I just didn’t understand AI any more. As I know I don’t have up to date AI knowledge, the algorithm appeared more believable. I hiked deep down the uncanny valley with that one.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by p1esk on Sunday July 19, 2020 @06:55PM
(#23893132)
This comment didn’t pass my gpt filter.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by foobarbecue on Sunday July 19, 2020 @01:13AM
(#23887176)
Your second paragraph is GPT-3?
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by O_H_E on Sunday July 19, 2020 @01:45AM
(#23887285)
Ok, now this is getting deep and I don't like it.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by Scarblac on Sunday July 19, 2020 @03:44AM
(#23887726)
I assume both previous comments, and this one, are also GPT-3?
Edit: it is amusing to think that soon the way to distinguish them will be that human comments have weird errors caused by smartphone keyboard "spell checking" in them...
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by p1esk on Sunday July 19, 2020 @04:11AM
(#23887846)
You really think my comment above was GPT-3 generated? Wow. Did I really make so little sense?
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by foobarbecue on Monday July 20, 2020 @07:21AM
(#23896715)
On a re-read, I'm not sure why I thought that, sorry. Context: I don't know much about machine learning and when I was scanning through comments, doing text generation one character at a time seemed silly and I must have been in the grips of "everything could be GPT!" hysteria. My robot detector needs work, clearly. Need to get educated.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by croddin on Sunday July 19, 2020 @04:40AM
(#23887941)
But then if the models are trained on that dataset they might make the same errors to better approximate humans on the forum.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by more-coffee on Sunday July 19, 2020 @06:16AM
(#23888331)
This entire thread is surrealistic and giving me Blade Runner vibes.. I love it.
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by che_shirecat on Sunday July 19, 2020 @03:10PM
(#23891596)
What if the plot twist line is also GPT-3?
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin
by killerstorm on Sunday July 19, 2020 @04:57AM
(#23888002)
Well, you'd need to train it from scratch to operate on character level. And it would have smaller context, thus lower quality. So if you want same quality, you need much bigger context.
Still, would be an interesting experiment. Gwern swears it would improve stuff, so worth trying and comparing, I guess
In fact, while reading that comment I started to wonder why no one has tried to use GPT to generate text one character at a time. Or if someone has, what are the advantages and disadvantages over the BPE approach.