News for hackers. Stuff that matters.

A comment on RedPajama (Open LLaMA Replication) 3B and 7B models released. Parent comment

Re:RedPajama (Open LLaMA Replication) 3B and 7B models released by rawrmaan on Friday May 05, 2023 @08:18PM (#35836697)
Oh I definitely agree that there are multiple levels of AI research that are valuable. Huge supporter of open source, and not meaning to talk down to anyone working on AI projects.

It's just that at the moment I'm finding the open source LLM community hard to contextualize from an outside perspective. Maybe it's because things are moving so fast (probably a good thing).

I just know that personally, I'm not going to be exploring any projects until I know they're near or exceeding GPT-4 performance level. And it's hard to develop an interest in anything else other than GPT-4 when comparison is so tough to begin with.

[ Parent | on HN ]
Re:RedPajama (Open LLaMA Replication) 3B and 7B models released by joshvm on Friday May 05, 2023 @08:38PM (#35836818)
I'd suggest reading the recently leaked Google memo for some context about why open source LLMs are important. It gives a good insight into why potentially closed source models like GPT-4 might be overtaken by open source even if they can't directly compete at the moment.

https://www.semianalysis.com/p/google-we-have-no-moat-and-ne...

[ Parent | on HN ]
Re:RedPajama (Open LLaMA Replication) 3B and 7B models released by rawrmaan on Friday May 05, 2023 @11:15PM (#35837617)
This was great. The timeline was the perfect catch-up I needed. Thank you!
[ Parent | on HN ]