News for hackers. Stuff that matters.

A comment on Amazon announces 'Bedrock,' its ChatGPT and DALL-E rival. Parent comment

Re:Amazon announces 'Bedrock,' its ChatGPT and DALL-E rival by lovesdogsnsnow on Friday April 14, 2023 @05:00PM (#35574702)
Aren't interconnect bandwidth and latency important for training workloads?
[ Parent | on HN ]
Re:Amazon announces 'Bedrock,' its ChatGPT and DALL-E rival by cavisne on Monday April 17, 2023 @01:09AM (#35597040)
Yes, but to move the needle you need to use another single vendor Mellanox (which nvidia owns).

So the (slight) differentiations are.

AWS - gpudirect and high bandwidth (but also high latency)

GCP - 16 gpus on one machine

Azure/OCI - mellanox

[ Parent | on HN ]