News for hackers. Stuff that matters.

A comment on Performance of llama.cpp on Apple Silicon A-series. Parent comment

Re:Performance of llama.cpp on Apple Silicon A-series by idonotknowwhy on Tuesday December 19, 2023 @07:10PM (#38703786)
Yeah prompt processing is tokenizing the input, which includes the system prompt, chat history and your chat text.

Generation is the response it sends back

[ Parent | on HN ]

There are no comments on this comment yet.