News for hackers. Stuff that matters.
Re:Performance of llama.cpp on Apple Silicon A-series by Havoc on Tuesday December 19, 2023 @08:15PM (#38704330)
Apples stinginess with Ram in phones may come back to bite them on LLMs
Re:Performance of llama.cpp on Apple Silicon A-series by saurik on Wednesday December 20, 2023 @01:48AM (#38706098)
I would think the opposite would happen, as they'll be very excited by people having to buy entirely new phones just to use LLMs ;P.