What Is ChatGPT Doing and Why Does It Work?

Re:What Is ChatGPT Doing and Why Does It Work? by hinkley on Wednesday February 15, 2023 @11:21AM (#34805965)

It really isn’t. I’m curious which pundits you’ve been listening to that are claiming Moore’s Law didn’t cap out back around 2015. We can only solve some of our problems with core count, and core count cares a great deal about Dennard’s Law, as well as Gustafson’s Law if not Amdahl’s.

Data center energy usage is becoming a category of its own with regard to carbon footprint. And of course the power dissipation of a data center is proportional to ambient temperature. As long as we don’t reach a dystopia where humans have to justify the air they breathe, replacing humans with machines has other problems than BTUs per unit of GDP.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by eru on Wednesday February 15, 2023 @01:05PM (#34807966)

Moore's law talks about the number of transistors in the chip that's cheapest per transistor. It's not talking about CPUs specifically.

So GPUs or even more 'exotic' beasts like TPUs count for Moore's law.

Moore's law doesn't say anything about how useful those transistors are. Nor does increasing core count somehow fall afoul of Moore's law.

[ Parent | on HN ]