Re:Apple: Transformer architecture optimized for Apple Silicon
by endisneigh on Thursday March 23, 2023 @07:11PM
(#35282806)
I never said anything about openai not being relevant. the point is scale and good enough. gpt-4 is already good enough for most reasonable use cases, notably siri optimization. 5 years is a long time. 5 years ago llms didn't even exist.
[ Parent
| on HN ]
Re:Apple: Transformer architecture optimized for Apple Silicon
by shmoogy on Thursday March 23, 2023 @07:16PM
(#35282857)
Gpt3.5-turbo runs laps around siri and is cheap, surely Apple will acquire talent to build something that does remote queries and falls back to local for the next 1-2 years while they figure out on device accelerated LLMs
Re:Apple: Transformer architecture optimized for Apple Silicon
by scarface74 on Thursday March 23, 2023 @08:37PM
(#35283563)
People keep saying this. But it’s only half the problem to process natural language in text form. How well would ChatGPT do at understanding Spanish from a non native speaker with a southern US accent? (Raises hand). I’ve yet to see a speech to text system that does well at understanding speech by non native speakers or even native English speakers with a heavy regional accent.
Re:Apple: Transformer architecture optimized for Apple Silicon
by yazaddaruvala on Thursday March 23, 2023 @09:52PM
(#35284074)
We have yet to see any Large Speech Models or Large Multimodal Models that use speech and text as inputs.
It’s only the being but the general process to build this stuff now exists and the value proposition is crystal clear.
Re:Apple: Transformer architecture optimized for Apple Silicon
by crooked-v on Thursday March 23, 2023 @09:59PM
(#35284114)
I don't think they'd even need to go that far to get started. Alpaca-LoRA is better than Siri when it comes to understanding queries and can already run on consumer GPUs. I would be really surprised if they couldn't get something equivalent running on the top-series A-chip devices in relatively short order.
Re:Apple: Transformer architecture optimized for Apple Silicon
by smoldesu on Thursday March 23, 2023 @07:22PM
(#35282917)
> 5 years ago llms didn't even exist
Almost 5 years ago TalkToTransformer did 80% of ChatGPT's job with 0% of the hype. Once people realize just how glacial all this stuff moves, I think the honeymoon phase will be over.
Re:Apple: Transformer architecture optimized for Apple Silicon
by endisneigh on Thursday March 23, 2023 @07:24PM
(#35282943)
right, that's why I mentioned performance at the current level at far less compute, and not necessarily better performance.