Re:OpenAI employees did not want to go work for Microsoft
by lumost on Friday December 08, 2023 @10:29AM
(#38570176)
GPUs will be cheaper later. GPUs have still been tracking Moore's law, enterprise GPUs went from a niche product to being the hottest enterprise hardware overnight. Margins on H200's are massive from what I understand. I would bet that we'll see massive competition in the hardware space from AMD, NVDA, MSFT, AMZN, and GOOG + startups.
We're likely to see an 8-16x reduction in hardware costs over the next decade. That's about enough to shrink the current GPT-4 inference endpoints to a laptop/desktop sized hardware footprint.
We're likely to see an 8-16x reduction in hardware costs over the next decade. That's about enough to shrink the current GPT-4 inference endpoints to a laptop/desktop sized hardware footprint.