News for hackers. Stuff that matters.
Re:M4 MacBook Pro by lightoverhead on Wednesday October 30, 2024 @02:11PM (#41998406)
The machine is great! How is its performance for AI model training? A lot of library and tools are not built for M series chip
Re:M4 MacBook Pro by treprinum on Wednesday October 30, 2024 @04:08PM (#41999637)
Poor. My M3 Max/128GB is about 20x slower than 4090. For inference it's much better, still much slower than 4090 but it enables working with much larger LLMs albeit at ~10t/s (in comparison, Threadripper 2990WX/256GB does like 0.25t/s). M4 Max is likely going to be ~25% faster than M3 Max based on CPU perf and memory bandwidth.