What Is ChatGPT Doing and Why Does It Work?

Re:What Is ChatGPT Doing and Why Does It Work? by hinkley on Wednesday February 15, 2023 @05:00AM (#34801880)

Don’t worry, the death of Dennard scaling and the specter of global warming will fix that, at least for some of us. There’s a lot of busy work and glue code to be automated but they’ve been trying to kill off development this way for at least forty years and all that changes is we get more sophisticated.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by eru on Wednesday February 15, 2023 @05:37AM (#34802115)

I wonder how you see global warming having an impact at all here?

Yes, Dennard scaling seems to be over, but Moore's law is still alive and kicking.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by hinkley on Wednesday February 15, 2023 @11:21AM (#34805965)

It really isn’t. I’m curious which pundits you’ve been listening to that are claiming Moore’s Law didn’t cap out back around 2015. We can only solve some of our problems with core count, and core count cares a great deal about Dennard’s Law, as well as Gustafson’s Law if not Amdahl’s.

Data center energy usage is becoming a category of its own with regard to carbon footprint. And of course the power dissipation of a data center is proportional to ambient temperature. As long as we don’t reach a dystopia where humans have to justify the air they breathe, replacing humans with machines has other problems than BTUs per unit of GDP.

[ Parent | on HN ]

Re:What Is ChatGPT Doing and Why Does It Work? by eru on Wednesday February 15, 2023 @01:05PM (#34807966)

Moore's law talks about the number of transistors in the chip that's cheapest per transistor. It's not talking about CPUs specifically.

So GPUs or even more 'exotic' beasts like TPUs count for Moore's law.

Moore's law doesn't say anything about how useful those transistors are. Nor does increasing core count somehow fall afoul of Moore's law.

[ Parent | on HN ]