News for hackers. Stuff that matters.
Re:Apple introduces M4 chip by unusualmonkey on Wednesday May 08, 2024 @07:14AM (#40296655)
There is no guarantee that local processing is going to have lower latency than remote processing. Given the huge compute needs of some AI models (e.g. chat gpt) the time saved by using larger compute likely dwarfs the relatively small time need to transmit a request.

There are no comments on this comment yet.