Re:How AI Is Catapulting Nvidia Toward the $1T Club
by haldujai on Friday May 26, 2023 @03:29PM
(#36088572)
Azure and AWS have both offered high-bandwidth cluster options that allow scaling beyond a single server for several months now.
Pretty sure MosaicML also does this but I haven't used their offering.
https://www.amazon.science/blog/scaling-to-trillion-paramete...
Because Nvidia created a supercomputer with A100, with lot of focus for networking. Cloud providers don't give that option.