News for hackers. Stuff that matters.
Re:Open Source AI Is the Path Forward by dogcomplex on Tuesday July 23, 2024 @11:51PM (#41053456)
Or just develop the next wave of chips designed for specifically transformer-based architectures (and ternary computing), and bypass the needs for GPUs and CUDA altogether
Re:Open Source AI Is the Path Forward by Zambyte on Wednesday July 24, 2024 @09:12AM (#41056740)
That would be betting against other architectures like Mamba, which does not seem like an obviously good bet to make yet. Maybe it is though.
Re:Open Source AI Is the Path Forward by dogcomplex on Friday July 26, 2024 @03:15AM (#41076496)
You're right, there are a number of avenues that are viable alternatives to the gpu monopoly.

I like the fact that these can be made with just mass-printed multiplication (and in ternary computing's case - addition) gates which require little more than 10 year old tech which is already widely distributed.