News for hackers. Stuff that matters.
Re:The genie escapes: Stanford copies the ChatGPT AI for les... by sebzim4500 on Monday March 20, 2023 @06:38PM (#35239847)
They probably put most of the effort into the 65B model, the 7B model was just trained so they could get an idea of the scaling behaviour. It makes sense to use the same amount of training steps, then.

There are no comments on this comment yet.