News for hackers. Stuff that matters.
Re:Stable Diffusion 1.5 by capitalsigma on Friday October 21, 2022 @08:41AM (#33287381)
I don't think that Moore's law is what's driving down ML compute costs in particular, where there seems to be a lot of innovation going on in terms of hardware architecture and compilers (much of which is proprietary). Even just thinking about memory bandwidth, which historically has scaled much slower than compute: the $/second required to push 10+ TB of training data into some piece of hardware that can do useful work on it isn't going to fall by 100x in a decade.
Re:Stable Diffusion 1.5 by elcomet on Friday October 21, 2022 @09:12AM (#33287646)
Moore's law is not driving anything, it's just an observation. The effet might have multiple causes. So Moore's law also applies here
Re:Stable Diffusion 1.5 by aliqot on Friday October 21, 2022 @09:32AM (#33287818)
Moore's law is obsolete, we're thermodynamics boys now. How much power can you turn into CPU cycles rather than heat. It's the next frontier.