News for hackers. Stuff that matters.
Re:Apple unveils new Mac Studio and brings Apple Silicon to ... by sliken on Monday June 05, 2023 @06:45PM (#36205210)
Likely better on any workloads that are GPU heavy and fit in 24GB of vram.

Two data points from Apple:

  a) M2 Ultra 24 cores, 128GB ram, 2TB storage = $5,200
  b) M2 ultra 24 cores, 192GB ram, 4GB storage = $6,600
Likely 1/4th the size, 1/4th the power consumption, and 4x the ram bandwidth. Have you by chance played with any LLMs? Just saw a post that someone managed 5 tokens/sec with the llama 65B model.
Re:Apple unveils new Mac Studio and brings Apple Silicon to ... by USB5 on Monday June 05, 2023 @07:17PM (#36205670)
I don't care about playing with LLMs, so this is simply meaningless to me.
Re:Apple unveils new Mac Studio and brings Apple Silicon to ... by kamranjon on Monday June 05, 2023 @11:54PM (#36207888)
But for many people training or running inference on large models is important and the apple approach actually makes that feasible in a desktop solution which is pretty awesome.
Re:Apple unveils new Mac Studio and brings Apple Silicon to ... by nightski on Monday June 05, 2023 @08:40PM (#36206534)
Weird I priced out the Mac Pro M2 Ultra 192GB just now on the site and it came out to $9,599.00 (with only a 1TB SSD).