News for hackers. Stuff that matters.
Re:Gemini Ultra Released by shantara on Thursday February 08, 2024 @07:50AM (#39301344)
I would have never guessed the answer. With such little data available, one can invent any arbitrary rules to fit their favorite answer.

It would be more impressive to practical use cases, if a LLM simply said that it's impossible to guess without inventing their own reasoning or looking up the answer online.

Re:Gemini Ultra Released by OJFord on Thursday February 08, 2024 @08:42AM (#39301794)
Same, I had to look to see what the intended answer was.

In fairness though, GPT4 was objectively incorrect, it's not even internally consistent or coherent - it either thinks b & h are vowels, or that lamb and squash don't end in those letters, or has changed its mind about the rule mid-sentence, or something.