News for hackers. Stuff that matters.

A comment on AI training is outpacing Moore’s Law. Parent comment

Re:AI training is outpacing Moore’s Law by hyperpallium2 on Wednesday December 08, 2021 @05:10PM (#29491209)
You're right about literal Moores Law, but its benefits are much diminished, of performance, power usage and cost. My understanding is the main problem is heat dissipation.

I've long predicted macrochips to solve this, brute force of huge quantities of silicon, but it hasn't really happened.

[ Parent | on HN ]
Re:AI training is outpacing Moore’s Law by rictic on Wednesday December 08, 2021 @06:15PM (#29491837)
Graphics cards and neural accelerators have continued an exponential improvement in performance per watt dollar, which is the intuitive thing that people often mean when they say Moore's law.
[ Parent | on HN ]