News for hackers. Stuff that matters.
Re:Nvidia pursues $30B custom chip opportunity with new unit by rrrix1 on Sunday February 11, 2024 @03:03PM (#39338114)
Calling a Mac Studio equipped with 192GB of RAM "consumer grade" is a big stretch.

"Consumer ${thing}" to me is somewhere =< $3000.

Re:Nvidia pursues $30B custom chip opportunity with new unit by karolist on Sunday February 11, 2024 @04:28PM (#39338927)
True, but you get a full general compute machine for under $6k, after a few years you can sell it for 3-4k and upgrade to the latest one. Personally I think it's the best thing to happen to local LLMs, by accident. I have an M1 Max 64GB and I'm blown away every day by these local models. Apple didn't plan for it, but it happened by accident due to unified memory with godzillion throughput having integrated silicon.