News for hackers. Stuff that matters.
Re:Google scrambles to manually remove weird AI answers in s... by TeMPOraL on Saturday May 25, 2024 @07:34PM (#40478643)
> X is relative to a distribution on the questions we ask when we aren’t dealing with Encyclopedia Eric but with an LLM.

Assuming I understand what you mean here correctly, this should be the case for both LLMs and Encyclopedia Eric - there are topics Eric knows by heart (or thinks they know); there are specific phrases seared into his mind through sheer exposure during his life prior to becoming a living Encyclopedia. There are words he's used to, and exact synonyms he barely recognizes. All that means your chance of getting correct answer to your query depends, in complex and unknown to you way, on how you state it.

Re:Google scrambles to manually remove weird AI answers in s... by eynsham on Saturday May 25, 2024 @07:51PM (#40478714)
I think the thought experiment can be set up both ways. In one case Eric has a fixed probability of getting /any/ query right. (This might leave boosting open so we might want to gerrymander repeated queries out.) In the other this is relative to the distribution of queries.