News for hackers. Stuff that matters.
Re:New Mac Mini with M4 by cpuguy83 on Tuesday October 29, 2024 @02:20PM (#41987721)
And yet the GPU costs about as much as the whole Mac Mini and wouldn't even come close to fitting inside one.
Re:New Mac Mini with M4 by angoragoats on Tuesday October 29, 2024 @04:35PM (#41989067)
You're mostly correct, though a 4060Ti 16GB is 20-30% cheaper than the cheapest Mac Mini. More importantly though, "fits inside a Mac Mini" is not a criterion I'm using to evaluate whether a particular solution is suitable for LLM inference. If it is for you, that's fine, but we have vastly different priorities.