Re:Intel CEO: 'The entire industry is motivated to eliminate...
by kelipso on Thursday December 14, 2023 @09:40PM
(#38650539)
That doesn't really make sense. Pretty much all LLMs are trained in pytorch, which is open source. LLMs only reached the state it is now because many academic conferences insisted that paper submissions have open source code attached to it. So much of the ML/AI ecosystem is open source. Pretty much only CUDA is not open source.
[ Parent
| on HN ]
Re:Intel CEO: 'The entire industry is motivated to eliminate...
by DeathArrow on Friday December 15, 2023 @02:41AM
(#38651933)
>Pretty much only CUDA is not open source.
What stops Intel to make their own CUDA and plug in into pytorch?
Re:Intel CEO: 'The entire industry is motivated to eliminate...
by nemothekid on Friday December 15, 2023 @03:09AM
(#38652088)
CUDA is huge and nvidia spent a ton in a lot of "dead end" use cases optimizing it. There have been experiments with CUDA translation layers with decent performance[1]. There are two things that most projects hit:
1. The CUDA API is huge; I'm sure Intel/AMD will focus on what they need to implement pytorch and ignore every other use case ensuring that CUDA always has the leg up in any new frontier
2. Nvidia actually cares about developer experience. The most prominent example is Geohotz with tinygrad - where AMD examples didn't even work or had glaring compiler bugs. You will find nvidia engineer in github issues for CUDA projects. Intel/AMD hasn't made that level of investment and thats important because GPUs tend to be more fickle than CPUs.
Re:Intel CEO: 'The entire industry is motivated to eliminate...
by mschuster91 on Friday December 15, 2023 @02:52AM
(#38651988)
The same shit as always, patents and copyright.