Re:Chiplet ASIC supercomputers for LLMs like GPT-4
by saturn99 on Wednesday July 12, 2023 @06:06PM
(#36702325)
Seems to align with Google, seems like they release a new TPU every 1.5 to 2 years.
I think modern LLMs are powerful enough now that they will still be useful in a couple years even if they aren't state-of-the-art. ChatGPT still lets you run their older model for cheaper than running GPT4, I could see a world where GPT4 is still available in 1.5 years even if there are better models out there.
I think modern LLMs are powerful enough now that they will still be useful in a couple years even if they aren't state-of-the-art. ChatGPT still lets you run their older model for cheaper than running GPT4, I could see a world where GPT4 is still available in 1.5 years even if there are better models out there.