News for hackers. Stuff that matters.
Re:Genie 2: A large-scale foundation world model by xnx on Wednesday December 04, 2024 @01:16PM (#42320271)
Could definitely be different based on use case. I wonder what causes the negative Gemini sentiment here to be so different from the Leaderboard results at https://lmarena.ai/?leaderboard
Re:Genie 2: A large-scale foundation world model by mistercheph on Wednesday December 04, 2024 @04:43PM (#42322344)
Most people seem to form and quickly calcify their opinions about LLM's based on a really small sample of initial uses.

In my experience, all of the leading edge models fall over in the same ways that people are mentioning here as particularly frustrating with Gemini(s), it is just a matter of probability, I tend to sample multiple models and multiple formulations when I have a question, and sometimes you hit the "jackpot" where the particular sequence of input tokens have pushed one model to exactly the right zone to start printing the tokens I want.

Re:Genie 2: A large-scale foundation world model by xnx on Wednesday December 04, 2024 @05:20PM (#42322682)
> Most people seem to form and quickly calcify their opinions about LLM's based on a really small sample of initial uses.

I agree. This is one reason I like the "blind taste test" approach of LM Arena.