News for hackers. Stuff that matters.
Re:Meta Llama 3 by brandall10 on Friday April 19, 2024 @11:32AM (#40088090)
There are rumors about an upcoming M3 or M4 Extreme chip... which would certainly have enough RAM, and probably a 1600-2000 GB/s bandwidth.

Still wouldn't be super performant AFA token gen, ~4-6 per second, but certainly runnable.

Of course by the time that lands in 6-12 months we'll probably have a 70-100G model that is similarly performant.

There are no comments on this comment yet.