News for hackers. Stuff that matters.
Re:SiFive Rolls Out RISC-V Cores Aimed at Generative AI and ML by elwypea on Tuesday October 17, 2023 @09:15AM (#37914495)
That might be good enough to get a hardware startup acquired, but not good enough to get major sales. Users want pytorch and negligible switching cost between chips.

Bigger problem for startups trying to muscle in on LLMs is that there isn't much room for improvement on existing solutions to do something radically different.

Re:SiFive Rolls Out RISC-V Cores Aimed at Generative AI and ML by lumost on Tuesday October 17, 2023 @01:25PM (#37918430)
>Bigger problem for startups trying to muscle in on LLMs is that there isn't much room for improvement on existing solutions to do something radically different.

aye - unless you are able to notch a 10x cost/performance improvement. The migration overhead will just make it not worth it to switch.