News for hackers. Stuff that matters.

A comment on What's new in Llama 2 and how to run it locally. Parent comment

Re:What's new in Llama 2 and how to run it locally by petulla on Monday August 07, 2023 @02:20AM (#37030858)
What's the inference time without gpu?
[ Parent | on HN ]
Re:What's new in Llama 2 and how to run it locally by lm2s on Monday August 07, 2023 @02:36AM (#37030975)
It might the time mentioned at the bottom of the page since the author isn't sure that the GPU is being used:

>How to speed this up—right now my Llama prompts often take 20+ seconds to complete.

[ Parent | on HN ]