News for hackers. Stuff that matters.

A comment on Stability AI Launches the First of Its StableLM Suite of Language Models. Parent comment

Re:Stability AI Launches the First of Its StableLM Suite of ... by viraptor on Wednesday April 19, 2023 @06:05PM (#35633903)
That doesn't sound likely with the current architectures. There may be some kind of specialisation, but NN is like the chip design nightmare. We can't do chips that that many crossed lines. It's going to have to keep the storage+execution engine pattern unless we have done breakthroughs.

"More specialised than GPU" is the game for now.

[ Parent | on HN ]
Re:Stability AI Launches the First of Its StableLM Suite of ... by zamnos on Wednesday April 19, 2023 @08:06PM (#35634845)
Not even with 3d chip-stacking?
[ Parent | on HN ]
Re:Stability AI Launches the First of Its StableLM Suite of ... by viraptor on Wednesday April 19, 2023 @08:31PM (#35634986)
Well, we'll see what the future manufacturing brings, but right now we're not even at thousands of layers (as far as I know... please link if there's been more), and we'd need to be in hundreds of thousands range. Given the rate of defects also adding up and the need for some way to dissipate the heat... Yeah, still lots of challenges there.
[ Parent | on HN ]