Re:AI will enable mass spying
by asdff on Tuesday December 05, 2023 @02:24PM
(#38535688)
While this is true, I don't think we are there yet with AI since its usually more expensive to run AI models than it is to perform more traditional statistical modelling.
[ Parent
| on HN ]
Re:AI will enable mass spying
by matthewdgreen on Tuesday December 05, 2023 @03:00PM
(#38536187)
A text recognition and face/object recognition model runs on my iPhone every night. A small LLM is used for autocorrect. Current high-end smartphones have more than enough RAM and compute to run pretty sophiscated 7B-param quantized LLMs. This level of capability will find its way down to even entry-level Walmart phones in about five years. Server side, things are going to be even cheaper.
> usually more expensive to run AI models
Machine learning inferencing on phones is cheap these days