News for hackers. Stuff that matters.
Re:Apple: Transformer architecture optimized for Apple Silicon by hardware2win on Friday March 24, 2023 @07:23AM (#35287586)
OpenAI and MSFT couldnt figure it out and are burning milions of USD on compute, but Apple will make it run on phone in 5 years?

Crazy bet, what makes you think that? You cannot optimize infinitely. Raytracing probably had decades of ppl trying to make it run fast and yet even today you need strong hardware

Re:Apple: Transformer architecture optimized for Apple Silicon by aunty_helen on Friday March 24, 2023 @07:36AM (#35287707)
Have a look at what the opensource community is up to. They're reducing models down to the meer billions of nodes and then using chatgpt to train their model accuracy. The results are suprising.

The reason openai have had to rush out plugins is due to software like langchain coming in at meteoric speed.

Things are moving on a day to day basis in the ai sphere at the moment.