Re:M4 MacBook Pro
by ZeroCool2u on Wednesday October 30, 2024 @01:28PM
(#41997883)
Training is not practical. For inference they're pretty great though, especially if you go up in the specs and add a bunch of memory.
To run LLMs locally (Ollama/LLM Notebook), you want as much memory as you can afford. For actually training toy models yourself for learning/experiments in my experience it doesn't matter much. PyTorch is flexible.
I've heard it's easier to just use cloud options, but I sill like the idea of being able to run actual models and train them on my laptop.
I have a M1 MacBook now and I'm considering trading in to upgrade.
I've seen somewhat conflicting things regarding what you get for the money. For instance, some reports recommending a M2 Pro for the money IIRC.