News for hackers. Stuff that matters.
Re:AI will enable mass spying by asdff on Tuesday December 05, 2023 @02:24PM (#38535688)
While this is true, I don't think we are there yet with AI since its usually more expensive to run AI models than it is to perform more traditional statistical modelling.
Re:AI will enable mass spying by matthewdgreen on Tuesday December 05, 2023 @03:00PM (#38536187)
A text recognition and face/object recognition model runs on my iPhone every night. A small LLM is used for autocorrect. Current high-end smartphones have more than enough RAM and compute to run pretty sophiscated 7B-param quantized LLMs. This level of capability will find its way down to even entry-level Walmart phones in about five years. Server side, things are going to be even cheaper.
Re:AI will enable mass spying by xcv123 on Tuesday December 05, 2023 @05:21PM (#38537740)
> usually more expensive to run AI models

Machine learning inferencing on phones is cheap these days

https://apple.fandom.com/wiki/Neural_Engine