News for hackers. Stuff that matters.
Re:Understanding Google’s File System (2020) by bushbaba on Thursday September 01, 2022 @04:03PM (#32682303)
The ability to join datasets at google through BQ and 'Flink' like pipelines was really un-matched. No matter what dataset you wanted it was accessible and joinable using the same data-lake, query tools, and ACL system. Sure teams differed in how they queried it (tool wise), but GFS made it all readily accessible for joining.

Most large orgs miss this when they make their data lake. Instead making a collection of silo'd data lakes

Re:Understanding Google’s File System (2020) by joshuamorton on Thursday September 01, 2022 @04:38PM (#32682805)
I am continually amazed by the accessibility and power of the query infrastructure, some of the queries I have written and seen are downright magic.