News for hackers. Stuff that matters.

A comment on Forget ChatGPT: why researchers now run small AIs on their laptops. Parent comment

Re:Forget ChatGPT: why researchers now run small AIs on thei... by upcoming-sesame on Saturday September 21, 2024 @06:54PM (#41613269)
I just tried now. Super easy indeed but slow to the point it's not usable on my PC
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by chaostheory on Saturday September 21, 2024 @08:51PM (#41613761)
You need an RTX 4090 if you want enough speed
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by leansensei on Monday September 23, 2024 @01:38AM (#41622646)
Please do not turn your own equipment into unqualified advice. Ollama runs great with a 4070 Super, and very likely also with a 4060.
[ Parent | on HN ]