Ask HN: Why is running Llama3 on Ollama so slow?

Posted by chirau on Sunday June 23, 2024 @01:24AM
from the ask-hn dept.

It is absolutely slow. All the other models run much faster than it.

Any suggestions on making it faster without having to buy new hardware would be welcome.

( 1 comment | on HN )

Re:Ask HN: Why is running Llama3 on Ollama so slow? by jmorgan on Monday June 24, 2024 @12:01AM (#40772574)

Sorry it's slow for you – happy to help debug why - shoot me an email at [email protected]

[ Parent | on HN ]