News for hackers. Stuff that matters.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by alfalfasprout on Tuesday March 14, 2023 @06:32PM (#35160046)
Keep in mind OpenAI is able to lose money on GPT*. Inference for the same predictive power will indeed improve (Facebook's recent model is a step in the right direction) but efficiency of running on given hardware likely won't follow moore's law for long.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by Raidion on Tuesday March 14, 2023 @06:48PM (#35160287)
Are there truely top tier ML optimized chips? I would imagine the hardware space still having room to grow if just because most of the brainpower having been focused on x86, etc.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by pixl97 on Tuesday March 14, 2023 @07:13PM (#35160766)
If you believe Nvidia market speak, they took AI and used it to optimize their A100 chips when creating the H100 line, so we're already using artificial brainpower on the problem.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by moffkalast on Tuesday March 14, 2023 @06:52PM (#35160366)
There are analog neural net accelerators that can get around lots of existing limitations, but still have a few of their own that need to be figured out.