News for hackers. Stuff that matters.
Re:Azure ChatGPT: Private and secure ChatGPT for internal en... by sytelus on Monday August 14, 2023 @01:10AM (#37117664)
LLaMA2 is still quite a bit behind ChatGPT 3.5 and this mainly get reflected in coding and math. It's easy to beat NLP based benchmark but much much harder to beat NLP+math+coding togather. I think this gap reflects gap in reasoning but we don't have a good non-coding/non-math benchmark to measure it.

There are no comments on this comment yet.