Re:Cassandra at Apple: 1000s of Clusters, 300k Nodes, 100 PB
by echelon on Saturday October 08, 2022 @06:29PM
(#33136647)
Sometimes things have to be built as layered abstractions in order for humans to reason about them at scale.
See also the natural stochastic gradient ascent that produced our crazy complicated metabolic pathways (and all of biology).
It's a sad and very inefficient picture though. Apple does not need this this much data processing. It's a grotesque amount per device. Or maybe they're just wasting insane amounts of energy doing lots and lots doing of stupid analytics...