News for hackers. Stuff that matters.
Re:Apache Flink by manigandham on Wednesday January 30, 2019 @10:17AM (#19035676)
We have also seen this. The huge memory capacities now offered in the cloud makes single node processing very capable with entire TB datasets fitting into RAM, and running quickly enough to offset the hourly cost. Spark clusters are more efficient though for longer-running or continuous background processes.
Re:Apache Flink by riku_iki on Wednesday January 30, 2019 @01:23PM (#19037698)
And spark also has some other goodies: integration with storages, monitoring, fault tolerance, common algorithms implemented.