Re:AI's $600B Question
by LarsDu88 on Wednesday July 03, 2024 @06:43PM
(#40870731)
True that, but I think in a very short amount of time, using dedicated general purpose GPUs just for inferencing is going to be mega overkill.
If there's dedicated inferencing silicon (like say the thing created by Groq), all those GPUs will be power sucking liabilities, and then the REAL singularity superintelligence level training can begin.
Re:AI's $600B Question
by campers on Wednesday July 03, 2024 @08:52PM
(#40871454)
Etched is another dedicated inference hardware company that recently announced their product. It only works for transformer based models, but is ~20x faster than a H100
If there's dedicated inferencing silicon (like say the thing created by Groq), all those GPUs will be power sucking liabilities, and then the REAL singularity superintelligence level training can begin.