News for hackers. Stuff that matters.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by jefft255 on Monday February 15, 2021 @06:57PM (#26149332)
I think a better comparison would have been some of the smaller discrete GPU wielding laptop. You can get some of these for similar prices to the M1 macs.

Also, for me, the answer is no: they're not any good. I use PyTorch. I use custom CUDA code. The reality is brutal but simple: if it doesn't run CUDA, no serious ML research will use it for training anything else than toy models.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by visarga on Tuesday February 16, 2021 @12:03AM (#26151109)
> no serious ML research will use it for training anything else than toy models

They will use it to edit code, deploy and remotely run jobs. Serious deep learning on laptops is a non-starter, on any laptop, on account of heat dissipation.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by chungus_khan on Tuesday February 16, 2021 @08:38AM (#26153720)
And for that purpose it's nice, but as good as any other semi-modern laptop. Over quarantine I amused some coworkers by doing an entire day's work (not ML, but not stuff that's run locally) on an old VT220, with very little change in workflow.

Being able to do light stuff on one's own consumer hardware without having to buy something new is still incredibly helpful to students and other people trying to learn, as well as hobbyists though.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by ravi-delia on Tuesday February 16, 2021 @01:48PM (#26157309)
I mean it's 'better' in that it runs cooler and faster for longer than anything price equivalent, but that advantage will eventually be normal through the industry.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by ChuckNorris89 on Tuesday February 16, 2021 @01:12AM (#26151409)
Depends what do you mean by 'serious'?

Training Tesla's FSD neural net on a laptop? A student training some models for courses or self study?

Re:Are the New M1 Macbooks Any Good for Deep Learning? by WanderPanda on Tuesday February 16, 2021 @01:34AM (#26151513)
Exactly! I would guess that maybe 80% of monthly active deep learning users would benefit from a small accelerator like that. In contrast to that, probably less than 1% of the deep learning flops will benefit
Re:Are the New M1 Macbooks Any Good for Deep Learning? by 908B64B197 on Tuesday February 16, 2021 @11:45AM (#26155816)
> A student training some models for courses or self study?

Serious schools have computing clusters. ML researchers might be interested to know which undergrad is actually training models complex enough to benefit from better hardware.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by EveYoung on Tuesday February 16, 2021 @04:59AM (#26152520)
With WFH nowadays, I wouldn't even want a GPU workstation running at home considering the noise and power consumption. And with the high costs of a capable DS team, runing these workloads in the cloud doesn't make much of a difference either.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by 3np on Tuesday February 16, 2021 @05:14AM (#26152601)
Sounds like you haven't seen the cloud costs for processing units handling these workloads, then... They're severely overpriced compared to normal CPU loads.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by virgilp on Tuesday February 16, 2021 @01:17AM (#26151430)
They even buried it in the conclusion, after a few thousand words & charts designed to give the opposite impression:

> these still aren’t machines made for deep learning. Don’t get me wrong, you can use the MBP for any basic deep learning tasks, but there are better machines in the same price range if you’ll do deep learning daily.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by amitport on Tuesday February 16, 2021 @07:04AM (#26153133)
"buried it in the conclusion"

The article has 4 short sentences in the 'conclusion' section which can be found, as expected, at the end of the article.

it really isn't "buried"

Re:Are the New M1 Macbooks Any Good for Deep Learning? by virgilp on Tuesday February 16, 2021 @09:21AM (#26154068)
But it is. A regular conclusion summarizes the article, doesn't contradict it.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by slowhand09 on Tuesday February 16, 2021 @11:04AM (#26155160)
That's not buried. This is buried.

“But the plans were on display…”

“On display? I eventually had to go down to the cellar to find them.”

“That’s the display department.”

“With a flashlight.”

“Ah, well, the lights had probably gone.”

“So had the stairs.”

“But look, you found the notice, didn’t you?”

“Yes,” said Arthur, “yes I did. It was on display in the bottom of a locked filing cabinet stuck in a disused lavatory with a sign on the door saying ‘Beware of the Leopard.”

Re:Are the New M1 Macbooks Any Good for Deep Learning? by teruakohatu on Monday February 15, 2021 @07:12PM (#26149457)
> I think a better comparison would have been some of the smaller discrete GPU wielding laptop.

I agree, but from what I have seen they also perform poorly against collab. A 1660 Ti 4gb RAM laptop gpu, runs about as fast as Collab CPU does. [1]

I have not been able to find how the RTX 2080 Super (Laptop) and upcoming RTX 3080 (Laptop) compares to Collab. The 3080 has over 3x as many cores as the 1660 Ti.

[1] https://towardsdatascience.com/google-colab-how-does-it-comp...

Re:Are the New M1 Macbooks Any Good for Deep Learning? by apohn on Tuesday February 16, 2021 @09:33AM (#26154170)
>A 1660 Ti 4gb RAM laptop gpu, runs about as fast as Collab CPU does

According to the chart on that page you linked to the Lenovo Legion (with the 1660ti) is about 30% faster than the Colab GPU. The Lenovo 480s (CPU only, no GPU) is about the same speed as the Colab CPU. So if you can train your model on the on 4GB of VRAM, a laptop with a discrete GPU (if you exclude the really basic business laptop GPUs) may be useful.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by joshocar on Monday February 15, 2021 @09:47PM (#26150370)
Are the Quadro cards any good for it?
Re:Are the New M1 Macbooks Any Good for Deep Learning? by teruakohatu on Monday February 15, 2021 @10:36PM (#26150631)
They are, other than being priced more expensively compared with consumer cards. When doing things like RNN's, RAM becomes an issue regardless of how powerful the card is in other ways.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by winter_blue on Monday February 15, 2021 @07:15PM (#26149476)
In this particular use case, I would heartily recommend the Zephyrus G14.

It can come with a RTX 2060 (Max Q / low voltage) which supports CUDA; as well as Ryzen 9 4900HS, which was the fastest mobile CPU until the 5000 series mobile Ryzen came out.

The 2060 + 4900HS has gone on sale at Best Buy for $1199 multiple times late last year (just check slickdeals).

I think it’s absolute steal of a machine for that price. Not to mention that it’s beautifully built, is lightweight, has an amazing matte color accurate screen, etc.

There’s also a fan sub for this particular laptop with over 13k subscribers (as of today) on Reddit: https://www.reddit.com/r/ZephyrusG14/

Re:Are the New M1 Macbooks Any Good for Deep Learning? by sgillen on Monday February 15, 2021 @07:30PM (#26149584)
No doubt it's a good laptop. However I would recommend anyone looking at laptops with machine learning in mind seriously consider a cheaper / less powerful laptop, and to do their training remotely on either on a workstation or in someones cloud.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by adgjlsfhk1 on Monday February 15, 2021 @10:03PM (#26150458)
Or just build a cheap desktop with a gpu. rtx 2060 + nvme SSD + any cpu is pretty good for most ML, and will only cost $800 or so.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by rileymat2 on Monday February 15, 2021 @10:39PM (#26150657)
That is easy to say, but good luck finding a RTX 2060 at a reasonable price. I have been trying for a month and a half, and almost all graphics cards are not available.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by mehrdada on Monday February 15, 2021 @10:49PM (#26150708)
If you are in the US, you can easily buy a prebuilt machine that comes with RTX2060 for $1100-1200. Check Dell/Lenovo or Costco. Buying the card independently is pretty much impossible/uneconomical. If you don't want the rest of it, simply list the remains of the system with as a cheap PC with integrated GPU.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by PartiallyTyped on Tuesday February 16, 2021 @02:02AM (#26151612)
I'd recommend against Dell. A better option would be to purchase a gaming rig and install a flavour of linux on it. There's a video series from LinusMediaGroup that investigated different OEMs, Dell ended up overcharging/scamming them for services they didn't ask for and gave worse performance [1].

[1]https://youtu.be/Go5tLO6ipxw?t=73

Re:Are the New M1 Macbooks Any Good for Deep Learning? by Dylan16807 on Tuesday February 16, 2021 @01:35AM (#26151523)
But at that price now you're paying as much as the laptop and getting near-zero portability.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by izacus on Tuesday February 16, 2021 @03:46AM (#26152116)
And getting significantly more performance because those components can actually be cooled properly.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by winter_blue on Friday February 19, 2021 @08:41AM (#26193020)
I think if someone really needed the performance, they'd be using some much more powerful than the RTX 2060.

However, if your goal is just to have a machine on which you can actually test your CUDA code, then the Zephyris G14 laptop is perfect. It's portable, has a nice screen, etc.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by adrianN on Tuesday February 16, 2021 @01:56AM (#26151584)
But you get bigger fans and heatsinks.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by p1esk on Tuesday February 16, 2021 @02:23AM (#26151694)
Correction: if it doesn’t run Pytorch. No one really runs custom cuda code anymore. If you do, you’re an outlier.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by fxtentacle on Tuesday February 16, 2021 @02:37AM (#26151757)
I work in computer vision and pretty much all recent SOTA models had custom CUDA code. So I'd argue the opposite that in my field, lack of custom CUDA kernels will effectively exclude you from research.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by p1esk on Tuesday February 16, 2021 @03:10AM (#26151905)
Can you give an example?
Re:Are the New M1 Macbooks Any Good for Deep Learning? by fxtentacle on Tuesday February 16, 2021 @04:45AM (#26152449)
https://github.com/princeton-vl/RAFT#optional-efficent-imple...

It's "optional" in the sense that things still calculate correctly on CPU without it, but at a 1000x performance penalty. Or you could skip it if you had 64GB of GPU RAM, which you cannot buy (yet).

So if you actually want to work with this on GPUs that are commercially available, you need it.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by p1esk on Tuesday February 16, 2021 @05:39AM (#26152715)
Ok, so in this example the cuda code is only used when you're short on GPU memory. This means if Apple makes a chip with enough memory cuda compatibility won't be necessary, right?

Are there any examples where custom cuda code implements some op that can't be written in Pytorch/TF/Jax/etc? That would have provided a better support to your claim that M1 needs to be able to run cuda.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by jefft255 on Tuesday February 16, 2021 @09:58AM (#26154411)
Re:Are the New M1 Macbooks Any Good for Deep Learning? by p1esk on Tuesday February 16, 2021 @03:51PM (#26158662)
Here you go: https://github.com/yanx27/Pointnet_Pointnet2_pytorch - no need for any custom cuda code.

Note the cuda kernels in the original repo were added in August 2017. It might have been the case at the time they needed them, but again, if you need to do something like that today, you're probably an outlier. Modern DL libraries have a pretty vast assortment of ops. There have been a few cases in the last couple of years when I thought I'd need write a custom op in cuda (e.g. np.unpackbits) but every time I found a way to implement it with native Pytorch ops which was fast enough for my purposes.

If you're doing DL/CV research, can you give an example from your own work where you really need to run custom cuda code today?

Re:Are the New M1 Macbooks Any Good for Deep Learning? by pjmlp on Tuesday February 16, 2021 @05:46AM (#26152742)
I am CUDA fan, but it all depends how much adoption SYSCL manages to actually achieve.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by sillysaurusx on Tuesday February 16, 2021 @07:15AM (#26153182)
If you say so. I haven't used cuda in over a year, other than deploying to production. TPUs are probably the future (or something like a TPU, whenever Microsoft launches theirs).
Re:Are the New M1 Macbooks Any Good for Deep Learning? by hu3 on Monday February 15, 2021 @06:59PM (#26149344)
Is there a roadmap for CUDA support?

(downvoted for asking a honest question. Ahhh the things you see on Apple related posts... Emotion driven bunch)

Re:Are the New M1 Macbooks Any Good for Deep Learning? by sorenjan on Monday February 15, 2021 @07:08PM (#26149431)
A better question would be when will serious ML researchers stop using proprietary frameworks? The open source projects should work towards using something more open than Cuda, probably Vulkan. It's a real shame that Nvidia has a whole industry in their grip, and nobody seems to mind.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by swagonomixxx on Monday February 15, 2021 @09:05PM (#26150103)
Why would serious ML researchers stop using proprietary frameworks? They're the best that are out there right now, and ahead in pretty much every way than any other open source framework.

Researchers want to get their work done. They don't want to fight against their tools.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by sorenjan on Monday February 15, 2021 @10:51PM (#26150720)
They shouldn't, it was poor wording from me. What I meant was when will there be non proprietary frameworks available for researchers to use?

There's also the issue that by relying on proprietary frameworks that work now, you might be painting yourself into a corner if Nvidia changes something in the future and then you have to adapt to them because you have no choice.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by fluffything on Tuesday February 16, 2021 @03:00AM (#26151863)
When somebody pays somebody to write those frameworks.

When nvidia sees a need, they can change CUDA over night to address it, and they pay people to do that.

When you need to do the same in Vulkan, that’s a multi year process till your extension is “open”. A teaser here whose job is to get something done with ML has better things to do than going through that.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by make3 on Monday February 15, 2021 @09:12PM (#26150157)
lower reproducibility because drivers are blackboxes, worst prices if we're all only buying NVidia
Re:Are the New M1 Macbooks Any Good for Deep Learning? by jefft255 on Monday February 15, 2021 @07:54PM (#26149727)
We do mind, the incentives in academia are just not setup for people to build a replacement. Google are working on their TPUs which are even more closed. Facebook, MS. et al do not seem to be working on porting popular ML framework to something else...
Re:Are the New M1 Macbooks Any Good for Deep Learning? by russli1993 on Monday February 15, 2021 @07:30PM (#26149578)
cuda is basically equivalent to the combination of the instruction set and the C/C++ language, API and standard library, and all bundled together. In the CPU's case, C/C++, API and standard library are designed to be hardware platform agnostic, instruction sets is separate and open, and x86 have two players. Cuda became this way because it is designed by the hardware company and its business need. We really should be thankful that C/C++, open compilers, API and library exists in the CPU world back then. And hardware vendors like Intel published raw instruction sets and allow any software to target the instruction sets. I can't imagine in a world where people uses the programming language and libraries designed by a hardware CPU company and all that software only runs on hardware from such company.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by sorenjan on Monday February 15, 2021 @08:45PM (#26149998)
Some things were better back in the day. E-mail could not be invented today, it would be a mix of incompatible mail system like Facebook mail, Google mail, Apple mail, Slack mail, some distributed open source mail nobody used, etc.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by meepmorp on Monday February 15, 2021 @09:05PM (#26150105)
Go read the SMTP and related RFCs and see if you still think that email back in the day wasn’t already a mix of incompatible systems. The parts about address formats alone was quite an eye opener for me.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by brian_cunnie on Monday February 15, 2021 @09:46PM (#26150364)
Yes, I remember IBM had its own email system back in the early 80's when I worked there, AT&T had its own in the later 80's. Even Prodigy/Compuserve/AOL had proprietary email systems (IIRC) with internet email bolted on.

And getting email to the internet at large was no mean feat: I remember having to do a slew of UUCP addressing to get an email from AT&T to the internet (something along the lines of "astevens@[email protected]). It was the wild west.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by macintux on Monday February 15, 2021 @10:31PM (#26150599)
I applied for a sysadmin job at BBN in the late 90s, and X.400 knowledge was listed in the description. Thankfully that turned out to be a red herring.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by baq on Tuesday February 16, 2021 @05:05AM (#26152556)
email wouldn't be invented by private institutions today because nobody in their right mind would willingly get rid of their moat... it'd take government regulation to get there and you know how efficient that would be. technical problems are easy in comparison.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by dave_sullivan on Tuesday February 16, 2021 @03:22AM (#26151971)
Lots of people mind, but AMD screwed themselves by not jumping on deep learning years ago and the major open source efforts are all corporate sponsored and standardized around cuda. If you think you can make better, please do.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by hobofan on Tuesday February 16, 2021 @06:09AM (#26152856)
Yes, it is to a large degree AMD's fault, but NVIDIA also actively acted maliciously by neglecting OpenCL support, which meant that during the critical time 5-6 years ago, there was no realistic chance for the open alternative to succeed.

While developing a small competitor to Tensorflow back then (Leaf), we were one of the few frameworks that also tried to support OpenCL, but the additional dev work made it unfeasible.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by pjmlp on Tuesday February 16, 2021 @05:48AM (#26152751)
Easy, provide the graphical tooling, GPGPU debuggers and mature polylgot support for GPGPU.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by sudosysgen on Monday February 15, 2021 @09:51PM (#26150394)
SYCL is a good framework, that can translate to SPIR-V, OpenCL, CUDA, and so on.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by sorenjan on Monday February 15, 2021 @10:45PM (#26150682)
SYCL looks nice in theory, but AMD seems determined to stay irrelevant in GPGPU. To use SYCL on AMD you use a backend that targets ROCm, which still doesn't work on Windows. So why would I use that instead of Cuda and just not care about AMD's GPUs? A portable framework loses a lot of its meaning when it's not portable, and now SYCL just looks like an unnecessary layer over Cuda and OpenMP.

GPGPU has been a thing for 20 years now, and I still can't easily write code that works on Nvidia and AMD and ship it to consumers on Windows. From what I've seen OpenCL seems to be dying, AMD doesn't care about compute on Windows or on their Radeon cards, and Cuda continues to be the only real option year after year in this growing segment. Why would anyone buy anything else than Nvidia if they're using Photoshop, Blender, DaVinci Resolve, or other compute heavy consumer software? Maybe it's unrealistic to hope that any library can fix this and just rename GPGPU to Nvidia compute and be done with it.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by sudosysgen on Tuesday February 16, 2021 @12:09AM (#26151137)
I really don't get this. You can just use a SYCL backend that compiles to OpenCL or SPIR and target AMD GPUs. I did it yesterday. Use ComputeCpp and target AMD GPUs.

If you're using Blender it can absolutely make a ton of sense to use AMD hardware. For most of the time where Blender supported GPGPU AMD was the best choice, and I set up rendering servers with AMD hardware for that express purpose.

I feel like a big part of this attitude is from not actually having tried it. Because SYCL works fine on AMD. In fact, you have more backend options for AMD than NVidia.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by sorenjan on Tuesday February 16, 2021 @07:35AM (#26153293)
Which AMD cards though? It's one thing to be able to buy AMD hardware for your data center or workstations, but as far as I can see their latest consumer platform RDNA2 doesn't support ROCm [0]. Radeon DNA doesn't support Radeon Open Compute. ROCm have never supported Windows, and it doesn't look like there are any future plans for it either. And when looking at which AMD cards support SPIR or SPIR-V I can't find any good list, but I do find issues where AMD removed support in the drivers and told people to use old drivers if they needed it [1]. Compare to Nvidia where you can use any Geforce card you can find, so if you have a Nvidia GPU you know Cuda will work.

If you control your own hardware and software stack maybe an AMD CDNA card is fine, but if you want to ship software to end users it seems to be difficult to even know what will work. So you use cross platform code for a worse experience on Nvidia and spotty support on AMD, or only Cuda and accept that it's Nvidia only but will give you a better experience.

I haven't done a lot of GPGPU programming, but I've tried to look at it from time to time, and I've been disheartened by it every time. Nvidia's handling of OpenCL, AMD's disregard for SPIR. This is what an AMD representative had to say in 2019 [2]:

"For intermediate language, we are currently focusing on direct-to-ISA compilation w/o an intervening IR - it's just LLVMIR to GCN ISA. [...] Future work could include SPIRV support if we address other markets but not currently in the plans."

[0] https://github.com/RadeonOpenCompute/ROCm/issues/1180#issuec...

[1] https://community.amd.com/t5/opencl/spir-support-in-new-driv...

[2] https://github.com/RadeonOpenCompute/ROCm-OpenCL-Runtime/iss...

Re:Are the New M1 Macbooks Any Good for Deep Learning? by pjmlp on Tuesday February 16, 2021 @05:51AM (#26152775)
So basically buy into what CodePlay is selling instead of what NVidia is selling.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by mgreg on Monday February 15, 2021 @10:44PM (#26150678)
Doesn't Intel's OneAPI and it's DPC++ (in partnership with SYCL) attempt to do the same thing or something similar?

oneAPI DPC++ Features Included in SYCL 2020 Final Spec [https://newsroom.intel.com/articles/oneapi-dpc-features-2020...]

Arstechnia's write up on OneAPI provides a good overview [https://arstechnica.com/gadgets/2020/09/intel-heidelberg-uni...]

[edit: added arstechnia reference & link]

Re:Are the New M1 Macbooks Any Good for Deep Learning? by sudosysgen on Tuesday February 16, 2021 @12:10AM (#26151151)
I agree, DPC++ can also be used as a backend for SYCL IIRC.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by BadInformatics on Monday February 15, 2021 @10:43PM (#26150677)
Only if you want to write C++, which a diminishing number of ML researchers or practitioners do. SYCL makes more sense for traditional HPC, but since it works at the source level it doesn't make as much sense for ML framework codegen. Something like MLIR will hopefully help though (eventually).
Re:Are the New M1 Macbooks Any Good for Deep Learning? by sudosysgen on Tuesday February 16, 2021 @12:12AM (#26151164)
If you're going to be writing CUDA, then I don't think C++ will add a lot of overhead. In fact, I think that SYCL/C++ being single source makes it more ergonomic for GPU programming than higher level languages.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by xvilka on Monday February 15, 2021 @09:36PM (#26150295)
Precisely. And one of the worst companies by the attitude to the FOSS world. I hope, there will be more development from the AMD side for this. Otherwise we are doomed.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by sudosysgen on Monday February 15, 2021 @09:53PM (#26150403)
There is a lot that has been done. AMD's HIP and the open SYCL infrastructure can already run TensorFlow and can run a large amount of CUDA code. The reason the transition isn't being done is momentum and tradition, really.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by coayer on Monday February 15, 2021 @07:03PM (#26149393)
CUDA is proprietary and exclusive to Nvidia, so probably not! (Apple and Nvidia haven’t been cooperative for some time)
Re:Are the New M1 Macbooks Any Good for Deep Learning? by whywhywhywhy on Tuesday February 16, 2021 @05:42AM (#26152721)
It's even more absurd because Apple discontinued OpenCL and replaced it with their own proprietary solution too.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by make3 on Monday February 15, 2021 @09:16PM (#26150186)
Aside from the fact that CUDA is proprietary & very obviously made to lock people into using NVidia products, the thing is also that it's not just about CUDA. Indeed, deep learning primitives use CUDNN which have professionally written code hand tuned by PhDs in internal only assembly, getting performance not available to the public even if you did end up getting a CUDA compiler somehow.
Re:Are the New M1 Macbooks Any Good for Deep Learning? by cnasc on Monday February 15, 2021 @07:04PM (#26149400)
CUDA is Nvidia exclusive, no? I don’t think support for third party graphics hardware will be forthcoming
Re:Are the New M1 Macbooks Any Good for Deep Learning? by russli1993 on Monday February 15, 2021 @07:36PM (#26149619)
cuda is designed by nvidia, to lock software and applications to use Nvidia's hardware. Cuda is the core of Nvidia's business model. Cuda is the reason why Nvidia has the guts to charge $5000 for a data center or Quadro card when that card uses nearly the same silicon as the consumer versions and customers will still have to buy their cards.

Its like Apple sell you the iPhone, but also the iOS APIs and application model so you can run iOS apps. Once you run iOS apps, you are in Apple's ecosystem, both the ISVs and the user are hard to leave. Its like saying when will Apple officially make iOS APIs and libraries run on Android phones. Both will never happen.

Re:Are the New M1 Macbooks Any Good for Deep Learning? by jefft255 on Monday February 15, 2021 @07:04PM (#26149397)
Officially I don't see that coming, I think it's iffy in terms of patents etc...
Re:Are the New M1 Macbooks Any Good for Deep Learning? by eyelidlessness on Monday February 15, 2021 @08:59PM (#26150074)
Hey don't jump to conclusions, downvotes all around here! (I upvoted your perfectly reasonable and honest question)