News for hackers. Stuff that matters.

A comment on GPT4 is 8 x 220B params = 1.7T params. Parent comment

Re:GPT4 is 8 x 220B params = 1.7T params by karmasimida on Wednesday June 21, 2023 @02:46PM (#36422620)
Individual developers’ hardware and data has limit, I don’t see the OS models breaking into 100B models anytime soon
[ Parent | on HN ]

There are no comments on this comment yet.