Re:Web LLM – WebGPU Powered Inference of Large Language Models
by omneity on Saturday April 15, 2023 @09:49PM
(#35586513)
Apple should really jump on this and support teams working on local LLMs.
[ Parent
| on HN ]
Re:Web LLM – WebGPU Powered Inference of Large Language Models
by j45 on Saturday April 15, 2023 @09:53PM
(#35586528)
It hard not to wonder if some of today llm use cases weren’t kept in mind on the current Apple Silicon roadmap.
Re:Web LLM – WebGPU Powered Inference of Large Language Models
by Tepix on Sunday April 16, 2023 @02:52PM
(#35593127)
Have you seen this?
Re:Web LLM – WebGPU Powered Inference of Large Language Models
by omneity on Monday April 17, 2023 @02:00PM
(#35604228)
Yes and it's definitely a step in the right direction. It's beyond me whether this is enough of an effort to support the current LLM movement.
I expect Apple to be more proactive in these regards to capture the minds of a lightning-fast growing market increasingly slipping through its control (ChatGPT can be accessed from anywhere) and offer more incentives to developers, co-marketing being the lowest starting point.. probably something they're already working on and we didn't see the results of yet.