Re:You can now train a 70B language model at home
by sqreept on Friday March 08, 2024 @03:35AM
(#39639100)
M1, M2, M3 still have very low number of GPU cores. Apple should release some better hardware to take advantage of their recently released MLX library.
[ Parent
| on HN ]
Re:You can now train a 70B language model at home
by sbinnee on Friday March 08, 2024 @07:24AM
(#39640418)
At this moment it looks clear to me that Apple won’t go that way. It’s enough for them to focus on inference and actual application not the heavy training part. They have been probably training models on a cluster with non Apple silicon and make them available for their chips only for inference.
Re:You can now train a 70B language model at home
by ttul on Friday March 08, 2024 @10:36AM
(#39642009)
Not to mention entirely outsourcing training workloads to specialist firms. Apple does a lot of secretive outsourcing of things you might think they would or should do in-house. This contrasts with Google and Meta who seem to like keeping everything in-house.
Re:You can now train a 70B language model at home
by kergonath on Friday March 08, 2024 @10:41AM
(#39642074)
It’s true that their GPUs are slower than Nvidia’s. But keep in mind that cores are really different and cannot be compared across architectures. You want more Gflops, not necessarily more cores.