News for hackers. Stuff that matters.
Re:Llama 3.1 Official Launch by rcarmo on Tuesday July 23, 2024 @03:49PM (#41050056)
Re:Llama 3.1 Official Launch by jxy on Tuesday July 23, 2024 @05:19PM (#41051020)
Re:Llama 3.1 Official Launch by rcarmo on Tuesday July 23, 2024 @07:03PM (#41051935)
Still works fine for me. Latest ollama, running on NVIDIA.
Re:Llama 3.1 Official Launch by raminf on Tuesday July 23, 2024 @11:10PM (#41053304)
FWIW, 405B not working with Ollama on a Mac M3-pro Max with 128GB RAM.

Times out.

Re:Llama 3.1 Official Launch by pbmonster on Wednesday July 24, 2024 @02:52AM (#41054265)
Did you get a 2 bit quant? You need to chain several Mac Studios via Exo to get enough memory for a useful quant to work.