Re:Emerging Architectures for Modern Data Infrastructure
by bsder on Sunday October 18, 2020 @02:04AM
(#24815824)
The problem is that you are generally looking for "Something's different" rather than "Smooth ALL The Points".
So, the problem is that you threw away 90% of your data, and that's where the problem was. Oops. Now you have to switch on "Save all the data" and hope it repeats. So, given that you have to have a "Save all the data" switch anyhow, you might as well turn it on from the start.
In addition, changepoint analysis is an entire field of research in and unto itself.
Look at how many articles there are about analyzing "Did something break in my web service or am I really doing 10% more real traffic?"
So, the problem is that you threw away 90% of your data, and that's where the problem was. Oops. Now you have to switch on "Save all the data" and hope it repeats. So, given that you have to have a "Save all the data" switch anyhow, you might as well turn it on from the start.
In addition, changepoint analysis is an entire field of research in and unto itself.
Look at how many articles there are about analyzing "Did something break in my web service or am I really doing 10% more real traffic?"