News for hackers. Stuff that matters.
Re:Apple M3 Ultra by numpad0 on Wednesday March 05, 2025 @10:18AM (#43267674)
moot point if tok/s benchmark results are the same or worse.
Re:Apple M3 Ultra by kjreact on Wednesday March 05, 2025 @11:04AM (#43268399)
Are the benchmarks worse? Running LLMs in system memory is rather painful. I am having a hard time finding benchmarks for running large models using system memory. Can you point me to some benchmarks you’re referring to?
Re:Apple M3 Ultra by DrBenCarson on Wednesday March 05, 2025 @10:50AM (#43268201)
Not moot if you care about producing those tokens with the largest available models