News for hackers. Stuff that matters.
Re:RedPajama (Open LLaMA Replication) 3B and 7B models released by nullsense on Saturday May 06, 2023 @04:04AM (#35839224)
The pace of the progress the open source models are making is pretty astonishing. The smaller model sizes are cheap to train so there is a lot of iteration by many different teams. People are also combining proven approaches together. Then they're going to nail it and scale it. Will be very interesting to see where we are in 3 months time.

There are no comments on this comment yet.