Re:Microsoft introduces its own chips for AI, with eye on cost
by brucethemoose2 on Wednesday November 15, 2023 @04:47PM
(#38283020)
The answer is kinda "whatever Nvidia implements." Research papers literally build around their hardware capabilities.
A good example of this is Intel canceling, and AMD sidelining, their unified memory CPU/GPU chips for AI. They are super useful!.. In theory. But actually, they totally useless because no one is programming frameworks with unified memory SoCs in mind, as Nvidia does not make something like that.
As I already hinted in my post: I see a huge problem in the fact that in my opinion it still is not completely clear to this day which capabilities an AI accelerator really needs - too much is in my opinion still in a state of flux.