News for hackers. Stuff that matters.
Re:Daft: Distributed DataFrame for Python by sammysidhu on Friday March 01, 2024 @12:24PM (#39564103)
horizontal scaling however provides you with more aggregate network bandwidth. Most enterprises run workloads that downloads data from a data lake (usually S3), which is usually the bottleneck. Having horizontal scaling here allows the query leverage much higher network than just having a large single machine.

There are no comments on this comment yet.