News for hackers. Stuff that matters.

A comment on GPT4 is 8 x 220B params = 1.7T params. Parent comment

Re:GPT4 is 8 x 220B params = 1.7T params by ChatGTP on Wednesday June 21, 2023 @08:13AM (#36417476)
Is it a large language model anymore ? Something doesn’t quite add up?
[ Parent | on HN ]
Re:GPT4 is 8 x 220B params = 1.7T params by TeMPOraL on Wednesday June 21, 2023 @09:12AM (#36418021)
It's still large. But it might no longer need to be "only few entities on the planet can afford to make one, and not at the same time, since NVIDIA can pump out GPUs only so fast" large.
[ Parent | on HN ]