News for hackers. Stuff that matters.
Re:Exponentially Faster Language Modelling by godelski on Wednesday November 22, 2023 @02:17PM (#38383780)
Nvidia can't make GPUs fast enough. I doubt 10xing training and/or inference efficiency would result in a decrease in demand. I would be surprised if it didn't instead increase demand. Mind you, Nvidia is pushing hard on TensorRT which optimizes models at inference time and results in major increases in throughput (not 10x though lol).
Re:Exponentially Faster Language Modelling by rictic on Wednesday November 22, 2023 @05:33PM (#38386127)
Yeah, Jevons Paradox suggests that 10xing efficiency of training and inference would increase demand for GPUs.