News for hackers. Stuff that matters.
Re:Apple introduces M4 chip by gtirloni on Tuesday May 07, 2024 @04:51PM (#40291323)
> complete independence of network connectivity and hence minimal latency.

Does it matter that each token takes additional milliseconds on the network if the local inference isn't fast? I don't think it does.

The privacy argument makes some sense, if there's no telemetry leaking data.

There are no comments on this comment yet.