Re:Open Source AI Is the Path Forward
by dogcomplex on Tuesday July 23, 2024 @11:51PM
(#41053456)
Or just develop the next wave of chips designed for specifically transformer-based architectures (and ternary computing), and bypass the needs for GPUs and CUDA altogether
[ Parent
| on HN ]
That would be betting against other architectures like Mamba, which does not seem like an obviously good bet to make yet. Maybe it is though.
Re:Open Source AI Is the Path Forward
by dogcomplex on Friday July 26, 2024 @03:15AM
(#41076496)
You're right, there are a number of avenues that are viable alternatives to the gpu monopoly.
I like the fact that these can be made with just mass-printed multiplication (and in ternary computing's case - addition) gates which require little more than 10 year old tech which is already widely distributed.