When I was at Google, I was continuously amazed at how hard it was to stop this kind of own-goal when we knew it was happening. (Based on where I was inside Google, I came across (dramatically-less-sensational) obviously dumb decisions of this sort).
It was always shockingly hard as a Googler to get traction on fixing some customer's bureaucracy-navigation problem -- but usually it getting into the press finally got someone through the bureaucracy.
Rather than improve their AI to avoid more of these types of false positives, or invest in their customer support teams to deal with these situations, they can eliminate this entire class of false positives by scaring people with articles like this.
EDIT: which if true, is kind of extra fucked up when you consider the potential consequences of delaying medical treatment for a child.
It's one thing to get the attention of some Googlers on the front page of HN, it's a whole other order of magnitude for the front page of the NYT.
I cannot imagine how this hasn't become an urgent priority for Sundar himself to make sure this gets fixed and fast, at a minimum in these known situations. What could they possibly still be debating or deciding inside there at Google...? Police determined no charges, so restore the accounts. I don't see any potential risk, legal/reputational/otherwise, this would open up. Google's inaction here boggles the mind.
[1] https://www.nytimes.com/issue/todayspaper/2022/08/22/todays-...