News for hackers. Stuff that matters.
Re:Ask HN: Machine Learning Engineers, what do you do at work? by sigmoid10 on Friday June 07, 2024 @02:14PM (#40611312)
If you're still doing ML locally in 2024 and also use an ARM macbook, you're asking for trouble.
Re:Ask HN: Machine Learning Engineers, what do you do at work? by nicce on Friday June 07, 2024 @03:17PM (#40611940)
> ARM macbook

Funnily, the only real competitor for Nvidias' GPUs are Macbooks with 128GB of RAM.

Re:Ask HN: Machine Learning Engineers, what do you do at work? by hu3 on Saturday June 08, 2024 @08:34AM (#40617128)
And they don't compete in performance.
Re:Ask HN: Machine Learning Engineers, what do you do at work? by hkt on Saturday June 08, 2024 @10:41AM (#40617843)
I see your contemporary hardware choices and raise you my P900 ThinkStation with 256GB of RAM and 48 Xeon cores. Eventually it might even acquire modern graphics hardware.
Re:Ask HN: Machine Learning Engineers, what do you do at work? by spmurrayzzz on Friday June 07, 2024 @02:35PM (#40611546)
Can you expand on this a bit? My recent experiences with MLX have been really positive, so I'm curious what footguns you're alluding to here.

(I don't do most of my work locally, but for smaller models its pretty convenient to work on my mbp).

Re:Ask HN: Machine Learning Engineers, what do you do at work? by sigmoid10 on Saturday June 08, 2024 @09:08AM (#40617322)
MPS implementations generally lag behind CUDA kernels, especially for new and cutting edge stuff. Sure, if you're only running CPU inference or only want to use the GPU for simple or well established models, then things have gotten to the point where you can almost get the plug and play experience on Apple silicon. But if you're doing research level stuff and training your own models, the hassle is just not worth it once you see how convenient ML has become in the cloud. Especially since you don't really want to store large training datasets locally anyways.
Re:Ask HN: Machine Learning Engineers, what do you do at work? by genevra on Friday June 07, 2024 @02:53PM (#40611720)
For real
Re:Ask HN: Machine Learning Engineers, what do you do at work? by anArbitraryOne on Friday June 07, 2024 @04:40PM (#40612749)
I wish my company would understand this and let us use something else. Luckily, they don't really seem to care that I use my Linux based gaming machine most of the time
Re:Ask HN: Machine Learning Engineers, what do you do at work? by davedx on Saturday June 08, 2024 @02:21AM (#40615681)
What can I say, I enjoy pain!?
Re:Ask HN: Machine Learning Engineers, what do you do at work? by blitzar on Saturday June 08, 2024 @04:52AM (#40616250)
Nahh im l33t - intel macbook and no troubles.
Re:Ask HN: Machine Learning Engineers, what do you do at work? by rwalle on Saturday June 08, 2024 @09:17AM (#40617364)
can't read? parent clearly says "ARM macbook".