Re:The cost of cloud, a trillion dollar paradox
by jeffbee on Thursday May 27, 2021 @07:17PM
(#27309786)
The only question worth asking right there. It's the story of so many companies. We were doing something incredibly stupid, and in this five-part blog series we describe a slightly different implementation of an equally stupid idea.
Re:The cost of cloud, a trillion dollar paradox
by redis_mlc on Thursday May 27, 2021 @08:11PM
(#27310238)
That was my observation as a DBA.
The most powerful tools we have are aggregated reports and data retention periods, the same since the 1970s.
Running 10 copies of the same report (but each one with slightly different bugs) across 34 PB of data for 10 different departments is absurd, yet here we are.
Specifically for Dropbox, they're not a retailer like Safeway with 10,000 products and 100's of locations to crunch product and shipping data for - Dropbox could use a single server for their entire digital products data warehouse.
(I operated a data warehouse myself (literally) at Yahoo - 10 servers generating canned web reports for 500 managers. I heard they replaced it with a 1,000 node Hadoop cluster later.)
Yeah but why do they have 34 PB of analytics data?