News for hackers. Stuff that matters.

A comment on AI hype is over. AI exhaustion is setting in. Parent comment

Re:AI hype is over. AI exhaustion is setting in by Xiol32 on Friday May 17, 2024 @04:29PM (#40393907)
How are you running llama on the XTX? I have the same card and getting local LLMs running was always such a pain I've not tried in a while.
[ Parent | on HN ]
Re:AI hype is over. AI exhaustion is setting in by Zambyte on Friday May 17, 2024 @07:39PM (#40395204)
I'm running ollama on Ubuntu. I tried other distros first, but I ran into some issues. Pretty straightforward on Ubuntu.
[ Parent | on HN ]
Re:AI hype is over. AI exhaustion is setting in by fzzzy on Friday May 17, 2024 @05:19PM (#40394316)
I have only used nvidia cards, but in my experience kobold.cpp and ollama forks of llama.cpp can be easier to compile.
[ Parent | on HN ]