Re:MapR may shut down as investor pulls out after ‘extremely...
by threeseed on Thursday May 30, 2019 @05:10PM
(#20055947)
Spark is very much part of Hadoop. It uses Hadoop libraries throughout it including for the core part of reading/writing data
And that adage of big data can't fit in memory is nonsense these days. We run clusters with hundreds of terabytes of RAM which is very much big data. It's pretty easy and affordable with the cloud.
Re:MapR may shut down as investor pulls out after ‘extremely...
by notyourday on Thursday May 30, 2019 @06:13PM
(#20056477)
When was the last time you bought a MapR license to use it in a cloud?
When MapR was selling them the M5 and M7 were deployed in a data center on servers.
Re:MapR may shut down as investor pulls out after ‘extremely...
by brokensegue on Thursday May 30, 2019 @03:53PM
(#20055268)
i mean spark is often deployed on top of yarn where it's still in the "hadoop" sphere.
Re:MapR may shut down as investor pulls out after ‘extremely...
by notyourday on Thursday May 30, 2019 @05:08PM
(#20055933)
But I'm not loading up on my SuperMicro, Dell or HP servers. So there's no need to buy a decent Hadoop implementation from MapR.
I also think cloud based data lakes and tooling around them seriously decreased the appeal of Hadoop.
[0] If I can fit your big data into my memory, it is not "big data".