News for hackers. Stuff that matters.
Re:Apple: Transformer architecture optimized for Apple Silicon by shmoogy on Thursday March 23, 2023 @07:16PM (#35282857)
Gpt3.5-turbo runs laps around siri and is cheap, surely Apple will acquire talent to build something that does remote queries and falls back to local for the next 1-2 years while they figure out on device accelerated LLMs
Re:Apple: Transformer architecture optimized for Apple Silicon by scarface74 on Thursday March 23, 2023 @08:37PM (#35283563)
People keep saying this. But it’s only half the problem to process natural language in text form. How well would ChatGPT do at understanding Spanish from a non native speaker with a southern US accent? (Raises hand). I’ve yet to see a speech to text system that does well at understanding speech by non native speakers or even native English speakers with a heavy regional accent.
Re:Apple: Transformer architecture optimized for Apple Silicon by yazaddaruvala on Thursday March 23, 2023 @09:52PM (#35284074)
We have yet to see any Large Speech Models or Large Multimodal Models that use speech and text as inputs.

It’s only the being but the general process to build this stuff now exists and the value proposition is crystal clear.

Re:Apple: Transformer architecture optimized for Apple Silicon by crooked-v on Thursday March 23, 2023 @09:59PM (#35284114)
I don't think they'd even need to go that far to get started. Alpaca-LoRA is better than Siri when it comes to understanding queries and can already run on consumer GPUs. I would be really surprised if they couldn't get something equivalent running on the top-series A-chip devices in relatively short order.