News for hackers. Stuff that matters.
Re:Google's infamous internal 2010 “I just want to serve 5TB... by jamestimmins on Tuesday November 02, 2021 @01:52PM (#29084876)
As a friend of mine explained why she left Google a year or so ago, "I got tired of emailing 30 people to try to figure out who owned a single variable."
Re:Google's infamous internal 2010 “I just want to serve 5TB... by nostrademons on Tuesday November 02, 2021 @02:21PM (#29085319)
A TL I worked with once had a simple but effective strategy for that:

"Remove it and see who complains."

I did that (with the impenetrably named "PrefetchExperiment", last touched by a branch that lost previous file history in 2007). Turned out it was the source data for Google's DNS to figure out how to route queries to the lowest-latency datacenter, based on their geographic location. In about a month, it would've taken down all Google services. Oops.

It was a very effective way of figuring out who owned the variable and writing a big long comment explaining what it's there for and which team to contact before changing it, though.

Re:Google's infamous internal 2010 “I just want to serve 5TB... by ikiris on Tuesday November 02, 2021 @02:38PM (#29085588)
The hilarious thing is I know exactly what file you're talking about here.
Re:Google's infamous internal 2010 “I just want to serve 5TB... by AlexanderTheGr8 on Tuesday November 02, 2021 @02:37PM (#29085558)
LMAO, isn't this very similar to FaceBook's recent DNS problem?

Also I love the idea of removing it and seeing who complains.

Re:Google's infamous internal 2010 “I just want to serve 5TB... by zamadatix on Tuesday November 02, 2021 @03:19PM (#29086167)
Facebook's recent "DNS problem" was a process for checking routing failover capacity on the backbone for maintenance ended up taking down the backbone links. As a result of the servers being disconnected from the backbone they pulled their BGP advertisements since they considered their location to be unhealthy (no connection to the backbone).

FB's problem was the lack of routing reachability on its backbone triggering the lack of routing reachability information being sent to the larger internet, this in turn caused problems for DNS not the other way around.

Re:Google's infamous internal 2010 “I just want to serve 5TB... by _3u10 on Tuesday November 02, 2021 @02:42PM (#29085649)
It also works great for a product / bug backlog. Just delete the entire thing. If it's a real bug / feature it will get recreated.
Re:Google's infamous internal 2010 “I just want to serve 5TB... by joshuamorton on Tuesday November 02, 2021 @02:34PM (#29085526)
Scream tests are always fun. ("break it and see who screams")
Re:Google's infamous internal 2010 “I just want to serve 5TB... by raldi on Tuesday November 02, 2021 @02:08PM (#29085138)
The best and worst parts of being a Google engineer: Impossible things are merely very hard, but on the other hand, easy things are also very hard.