News for hackers. Stuff that matters.

A comment on Performance of llama.cpp on Apple Silicon A-series. Parent comment

Re:Performance of llama.cpp on Apple Silicon A-series by falcor84 on Tuesday December 19, 2023 @09:12PM (#38704682)
There are different possible approaches here, but for me, the main benefit would be of having control over the model(s) used. Other than that, low latency would be crucial for effective voice interaction.
[ Parent | on HN ]

There are no comments on this comment yet.