News for hackers. Stuff that matters.
Re:Llama 2 – Meta AI by gpm on Tuesday July 18, 2023 @02:36PM (#36777258)
This test seems to be testing the ability of it to accurately convey fine details about the world.

If that's what you're looking for it's a useful test, but if you're looking for a language model and not a general knowledge model I'm not sure it's super relevant. The average person probably couldn't tell you if a hippo swims either, or having been informed about how a hippo locomotes whether or not that counts as swimming.

Re:Llama 2 – Meta AI by jug on Tuesday July 18, 2023 @02:51PM (#36777475)
So it's more designed for a superficial chat?
Re:Llama 2 – Meta AI by andybak on Tuesday July 18, 2023 @03:01PM (#36777608)
False dichotomy alert
Re:Llama 2 – Meta AI by quickthrower2 on Tuesday July 18, 2023 @03:47PM (#36778200)
As am I
Re:Llama 2 – Meta AI by billythemaniam on Tuesday July 18, 2023 @05:00PM (#36779015)
No it's designed to generate text: summarize some text, grocery list for a steak dinner, name ideas, short stories, etc. I think a lot of people want LLMs to be encyclopedias, but that's not what they are designed to be or good at. The fact that they can do encyclopedia tasks at all is amazing.
Re:Llama 2 – Meta AI by TeMPOraL on Tuesday July 18, 2023 @08:04PM (#36780614)
No. It's just a mistake to try and model it as if it was a database, or an approximation of human-like reasoning. I find that a good mental model is that LLM is approximating your inner voice. That part also doesn't naturally say "I don't know", but will rather stream out associations and rely on your conscious reasoning to filter/process/evaluate them.