News for hackers. Stuff that matters.

A comment on Nvidia Dynamo: A Datacenter Scale Distributed Inference Serving Framework. Parent comment

Re:Nvidia Dynamo: A Datacenter Scale Distributed Inference S... by erulabs on Tuesday March 18, 2025 @06:28PM (#43405916)
It really depends on the task. If you have 1 massive job, Ray sucks and doesn't provide table stakes. If you have 50M tiny jobs, Ray and kuberay is great and serves as the backbone of several billion dollar products.

Good for the goose, good for the gander...

[ Parent | on HN ]
Re:Nvidia Dynamo: A Datacenter Scale Distributed Inference S... by richardliaw on Thursday March 20, 2025 @12:08PM (#43425117)
> If you have 1 massive job, Ray sucks and doesn't provide table stakes.

Can you say more?

[ Parent | on HN ]