Re:Tempering Expectations for GPT-3 and OpenAI’s API
by Bx6667 on Monday July 20, 2020 @07:07AM
(#23896638)
And precisely none of what you just said addresses my point.
Re:Tempering Expectations for GPT-3 and OpenAI’s API
by LoSboccacc on Monday July 20, 2020 @09:00AM
(#23897349)
> The point is that we are getting unintuitive and unexpected results.
> it will find unexpected correlations between data but there's zero indication whether these correlation bear any significance until a human goes validate the prompt, and it can generate infinite of these, making the discovery of significant new ideas pretty slim
seems a pretty direct response tbh
[dead]
Re:Tempering Expectations for GPT-3 and OpenAI’s API
by LoSboccacc on Monday July 20, 2020 @01:07PM
(#23899801)
it isn't really helpful or conductive of an interesting discussion that you are not detailing what the point is, even when the "the point is this" gets directly quoted, while not clarifying neither the point nor why the reply don't apply.
Re:Tempering Expectations for GPT-3 and OpenAI’s API
by Bx6667 on Monday July 20, 2020 @07:11PM
(#23902853)
These results are literally unexpected. The consensus of all the experts in 2010 was that none of this could possibly happen in the next ten years. The way these results were arrived at are unintuitive which probably has to do with why they were so utterly unexpected. The broad effort to mine “algorithm space,” which includes many different ML agents and other things, is producing results that were not expected. This is just a fact. There is no way around this. Just accept it and move on.
It’s obvious that the surprises will keep coming. We slowly close in on the algorithms that bring the silicon to its full potential. The real question is what is at the bottom? We keep digging and with more compute and more data eventually we will find that the stuff near the bottom is important and dangerous.
The fact that gtp3 has x flaw has absolutely no logical intersection with this. It’s basically unrelated.
however, if you remove the technical colored glasses and boil down what it is and what it does, it's a regurgitation of existing data that it had been fed, it has no understanding of the data itself beyond linguistic patterns.
it's not going to find correlations where there were none, it's not going to actually discover new data, it will find unexpected correlations between data but there's zero indication whether these correlation bear any significance until a human goes validate the prompt, and it can generate infinite of these, making the discovery of significant new ideas pretty slim.