Re:Unsealed court documents reveal data anarchy at Meta
by JKCalhoun on Thursday November 17, 2022 @08:33AM
(#33638584)
> When ordered to produce information about what 149 different data systems within Meta do, and what parts of Meta’s business use them, the company was unable to respond.
This feels to me more like a "tantrum-compliance" (I made it up) with a court order. But what do I know about it (nothing), maybe there is data anarchy at Meta.
Re:Unsealed court documents reveal data anarchy at Meta
by jsnell on Thursday November 17, 2022 @08:57AM
(#33638906)
No individual needs to know all of it. But any team owning a system that reads data should know what they're using it for. Likewise anyone providing data to other teams should at least know which other systems are reading that data; even if they don't know for certain what the data is used for they know who to ask about it. So the process of understanding can easily be sharded, and the results merged in a fairly mechanical manner.
The timeline here seems to be that they were asked for this in December and required to produce it in January. It probably is unreasonable to get this done from scratch in that time. But if they haven't started a project to do it by now, then it does feel a bit like they prefer being able to say "we don't know".
Re:Unsealed court documents reveal data anarchy at Meta
by jl6 on Thursday November 17, 2022 @08:41AM
(#33638702)
> The documents describe data anarchy within the company, where people responsible for data systems are unaware of how other people in the company use their system. In some cases even the engineers using a system may not be able to understand what is happening because, according to a Meta engineer, ‘it is not possible for humans to understand’.
Honestly, I think a lot of big orgs with deep legacy tech and a bunch of shadow IT are in a similar position.
Re:Unsealed court documents reveal data anarchy at Meta
by delusional on Thursday November 17, 2022 @08:49AM
(#33638823)
I work in an old school bank. Can confirm. You're lucky if people even know what the data they themselves use actually means. Usually there's all sorts of edge cases that make them go "ohh no, it can't do that, that would make it completely wrong", but it does do that and it is indeed wrong.
Re:Unsealed court documents reveal data anarchy at Meta
by doingtheiroming on Thursday November 17, 2022 @08:50AM
(#33638833)
This means that most European banks, big companies and government departments will soon be fined by the EU... The following could be said of almost all large corporations and institutions, including the year long project that failed to catalog data sources effectively:
"When ordered to produce information about what 149 different data systems within Meta do, and what parts of Meta’s business use them, the company was unable to respond. This was despite having conducted a year-long investigation of those systems."
There is no point having a law which essentially no company can be compliant with. It means that the law will almost certainly be applied only by exception and hence capriciously. The likes of Facebook may be able to use that as a defense despite their breaches being egregious.
As a side-note, the idea that Meta only has 149 in-scope data systems sounds ridiculous.
Re:Unsealed court documents reveal data anarchy at Meta
by Manfred on Thursday November 17, 2022 @08:58AM
(#33638926)
Lots of organizations and government agencies have already been fined because of these laws and lots of organizations comply with these laws. I work for a company that makes healthcare software solutions and we're fully compliant with the local GDPR laws.
Re:Unsealed court documents reveal data anarchy at Meta
by rainingmonkey on Thursday November 17, 2022 @09:01AM
(#33638954)
> people responsible for data systems are unaware of how other people in the company use their system. In some cases even the engineers using a system may not be able to understand what is happening because, according to a Meta engineer, ‘it is not possible for humans to understand’.
Sounds like a good way to hide a "Room 641A" situation from your own engineers...
But in general - as an industry, we aren't there yet. All judgments about Meta's practices aside - no large organization likely has the ability to comply with a law like this without years or decades of engineering work, and the law seems pretty clearly intended for selective enforcement.
Re:Unsealed court documents reveal data anarchy at Meta
by cvccvroomvroom on Thursday November 17, 2022 @09:51AM
(#33639612)
Uh, horse poo. Prod data is guarded like Fort Knox. No one can get access to anything on the graph without explicit approvals for a business purpose. I tried it. I can't even see who are my coworkers from my own FBID in internal apps.
This feels to me more like a "tantrum-compliance" (I made it up) with a court order. But what do I know about it (nothing), maybe there is data anarchy at Meta.
I wonder if the EU has the legal authority to force them to understand via some means? Otherwise it seems like a stretch of a demand.
The timeline here seems to be that they were asked for this in December and required to produce it in January. It probably is unreasonable to get this done from scratch in that time. But if they haven't started a project to do it by now, then it does feel a bit like they prefer being able to say "we don't know".
Honestly, I think a lot of big orgs with deep legacy tech and a bunch of shadow IT are in a similar position.
"When ordered to produce information about what 149 different data systems within Meta do, and what parts of Meta’s business use them, the company was unable to respond. This was despite having conducted a year-long investigation of those systems."
There is no point having a law which essentially no company can be compliant with. It means that the law will almost certainly be applied only by exception and hence capriciously. The likes of Facebook may be able to use that as a defense despite their breaches being egregious.
As a side-note, the idea that Meta only has 149 in-scope data systems sounds ridiculous.
Sounds like a good way to hide a "Room 641A" situation from your own engineers...
https://en.wikipedia.org/wiki/Room_641A
In the last few years, I feel like we've begun to crack it - dbt's data lineage graph is a huge advance over anything I've ever used before:
https://docs.getdbt.com/terms/data-lineage
But in general - as an industry, we aren't there yet. All judgments about Meta's practices aside - no large organization likely has the ability to comply with a law like this without years or decades of engineering work, and the law seems pretty clearly intended for selective enforcement.