Re:Apple: Transformer architecture optimized for Apple Silicon
by smoldesu on Thursday March 23, 2023 @07:50PM
(#35283168)
> Apple is really getting a niche here for machines to run models locally.
I... don't agree. They have an acceleration API and a large install-base, but all of these models have run just fine on traditional hardware. GPT-Neo, Stable Diffusion and LLaMa can all be used and accelerated without Apple Silicon.
Powerful, maybe. But not really unique, just putting up table stakes.
I... don't agree. They have an acceleration API and a large install-base, but all of these models have run just fine on traditional hardware. GPT-Neo, Stable Diffusion and LLaMa can all be used and accelerated without Apple Silicon.
Powerful, maybe. But not really unique, just putting up table stakes.