News for hackers. Stuff that matters.

A comment on Llama 2 – Meta AI. Parent comment

Re:Llama 2 – Meta AI by Roark66 on Wednesday July 19, 2023 @02:24AM (#36782745)
I have to say in my experience falcon-40b-instruct got very close to chatgpt (gpt-3. 5),even surpassing it in few domains. However, it is important to note (not at all)OpenAI are doing tricks with the model output. So comparing OS models with just greedy output decoding (very simple) is not fair for OS models.

Still, I'm very excited this model at 13B seems to be matching falcon-40B in some benchmarks. I'm looking forward to using it :-)

[ Parent | on HN ]
Re:Llama 2 – Meta AI by fnl on Wednesday July 19, 2023 @02:40AM (#36782834)
> OpenAI are doing tricks with the model output

Do you have any pointers to the “tricks” that are being applied?

[ Parent | on HN ]
Re:Llama 2 – Meta AI by jcuenod on Wednesday July 19, 2023 @08:41PM (#36795543)
Sounds like a reference to Mixture of Experts
[ Parent | on HN ]
Re:Llama 2 – Meta AI by zzzzzzzza on Thursday July 20, 2023 @08:57AM (#36799779)
could be something like prompt rewriting or chain of thought or reflexion going on in the background as well
[ Parent | on HN ]