The Mac Pro’s biggest problem is the MacBook

Re:The Mac Pro’s biggest problem is the MacBook by erichocean on Wednesday June 28, 2023 @09:58PM (#36515412)

I have two Mac Studios. When I need "more GPU horsepower", I spin up a GPU VM for $0.40-$0.80/hour (depending on my needs) and work away. Then I shut it off.

I can't be the only one doing ML development this way.

[ Parent | on HN ]

Re:The Mac Pro’s biggest problem is the MacBook by sarathyweb on Wednesday June 28, 2023 @10:33PM (#36515650)

Would you mind sharing what cloud provider you use?

[ Parent | on HN ]

Re:The Mac Pro’s biggest problem is the MacBook by erichocean on Wednesday June 28, 2023 @11:19PM (#36515930)

https://www.runpod.io/

I do have a Windows machine with an nVidia GPU (RTX 2070 Super), but I don't use it anymore (bought it years ago).

ML on the cloud is way more convenient because you can trivially adjust your cost based on what you're doing: Training? spin up something big/expensive. Inference? cheaper (less VRAM) is usually fine.

I also like that I can run multiple instances simultaneously, something that would be prohibitively expensive if I had to have multiple machines sitting around waiting for me to use them.

[ Parent | on HN ]

Re:The Mac Pro’s biggest problem is the MacBook by ClassyJacket on Wednesday June 28, 2023 @10:31PM (#36515639)

Sure. But there are alot more use cases for GPUs than machine learning, many of which are latency sensitive and must be done locally.

[ Parent | on HN ]