News for hackers. Stuff that matters.
Re:Google is investing $3.3B to build clean data centers in ... by opportune on Friday September 20, 2019 @12:39PM (#21028600)
Another way to get huge efficiency gains over using Hadoop is to intelligently memoize results and compute as-you-go. But that requires making some bespoke architecture. However I contend that at any scale where it actually makes sense to use Hadoop (especially in the cloud era), it will be cheaper in the medium-term of 1 year or so to dedicate developer time to make something more efficient than a big daily pipeline of Hadoop jobs

There are no comments on this comment yet.