News for hackers. Stuff that matters.
Re:Giving GPT-3 a Turing Test by phreeza on Monday July 20, 2020 @02:56AM (#23895332)
I guess it is a question of definitions, but i think it really is not possible, for the reason that the space of possible test sets includes contradictory sets. So if I ask you a simple question which is not in your training set, like "Does a Quigloth have eyes?", there can be two possible test sets, one where the answer is no, and one where the answer is yes. So a reply to this could be that questions have to be about the real world. But that is then the same "meta distribution" as I mentioned in my previous comment, and not out of distribution learning in the pure sense.

There are no comments on this comment yet.