News for hackers. Stuff that matters.

A comment on Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM. Parent comment

Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM by threeseed on Tuesday June 06, 2023 @06:22AM (#36210592)
There is a video [1] benchmarking last year's M1 Ultra against 3080ti for one ML use case and it was 3x slower. Apple MX does have neural engines which are used but not sure how they compare to CUDA cores.

Either way quite a bit better than 30x slower.

[1] https://www.youtube.com/watch?v=k_rmHRKc0JM

[ Parent | on HN ]
Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM by jorgemf on Tuesday June 06, 2023 @07:07AM (#36210911)
In that video they run the Linux experiments over a windows with a virtual machine. And I didn't see the model, but I bet you I can trains a model in a 4090 one 2x faster than in a old 1050 (because i can chose a model which bottle neck could be the data transfering not the actual computation).
[ Parent | on HN ]