News for hackers. Stuff that matters.
Re:Llama 2 is about as factually accurate as GPT-4 for summa... by waleedk on Tuesday August 29, 2023 @01:29PM (#37311126)
[Author] Can you cite some examples of this so we're not talking in the void?

I've actually tested Llama 2 for summarization but haven't blogged about that yet, and across multiple domains, Llama 2 is pretty good.

I do see some differences -- Llama 2 doesn't follow instructions as cleanly, and is more verbose.

It's not a plugin replacement -- in the article itself I point it out. GPT 3.5 largely followed instructions to return A or B. Llama 2 didn't so I had to use another LLM to post-process.

I'm not saying you should always use Llama 2 or ChatGPT. It's that for some use cases, you can save a lot of money by using an open source alternative.

There are no comments on this comment yet.