News for hackers. Stuff that matters.

A comment on Dear Google Cloud: Your Deprecation Policy Is Killing You. Parent comment

Re:Dear Google Cloud: Your Deprecation Policy Is Killing You by thethethethe on Saturday August 15, 2020 @01:03PM (#24170349)
> Yeah they built big table... But the rest of the industry standardized on Hadoop (at the time) because they never released an implementation and so they started losing out on good hires because they didn't want to get locked into proprietary Google infra.

Hadoop and Bigtable are not the same thing. Bigtable is a noSQL database. Hadoop is a big data processing framework. Hadoop is actually an open source implementation of MapReduce, which was developed at Google and which has since been replaced by Flume

[ Parent | on HN ]
Re:Dear Google Cloud: Your Deprecation Policy Is Killing You by manigandham on Monday August 17, 2020 @05:57AM (#24185671)
Hadoop is a collection of things: HDFS (filesystem), Hbase (keyvalue database), MapReduce (data processing), and YARN (resource scheduling and job management).

Hbase was open-source implementation of Bigtable while HDFS was a copy of Google File System. The divergence appeared with other processing frameworks like Spark but now there's Apache Beam to unify it all.

[ Parent | on HN ]
Re:Dear Google Cloud: Your Deprecation Policy Is Killing You by atombender on Saturday August 15, 2020 @01:26PM (#24170521)
On the other hand, Hadoop does have HBase, which is their version of Bigtable. It was, for a number of years, a very popular columnar K/V store.
[ Parent | on HN ]