Re:Mass Layoffs and Absentee Bosses Create a Morale Crisis a...
by MacsHeadroom on Wednesday April 12, 2023 @07:08PM
(#35548322)
There is zero evidence that GPT-4 is a trillion parameter model and some evidence that it is the same parameter size as GPT-3.
Newer research and models out of DeepMind etc. show that GPT-4 performance is attainable at 90% the size of GPT-3. It's well known by now that GPT-3 was hugely over parameterized.
Newer research and models out of DeepMind etc. show that GPT-4 performance is attainable at 90% the size of GPT-3. It's well known by now that GPT-3 was hugely over parameterized.