Re:GPT4 is 8 x 220B params = 1.7T params
by loudmax on Wednesday June 21, 2023 @09:56AM
(#36418511)
AI development is taking place at breathtaking velocity and GPT-4 isn't the end of the road. OpenAI's moat relies on them improving at a faster pace than competitors. I wouldn't take it for granted that OpenAI's lead will remain the same in a year as it is today. Very possibly they could expand their lead. Also possibly, their lead could vanish.
[ Parent
| on HN ]
Re:GPT4 is 8 x 220B params = 1.7T params
by karmasimida on Wednesday June 21, 2023 @02:46PM
(#36422620)
Individual developers’ hardware and data has limit, I don’t see the OS models breaking into 100B models anytime soon