News for hackers. Stuff that matters.

A comment on Finding a problem at the bottom of the Google stack. Parent comment

Re:Finding a problem at the bottom of the Google stack by jldugger on Monday March 16, 2020 @01:21AM (#22590237)
Anomaly detection on timeseries data is surprisingly bad. The data tends to be bad in all the wrong ways -- seasonal, and not normally distributed.

And worse, you have no training data, so ML model you train simply learns whatever badness is allowed to persist in production as normal.

[ Parent | on HN ]
Re:Finding a problem at the bottom of the Google stack by cranekam on Monday March 16, 2020 @03:06AM (#22590663)
I worked at a FAANG and every now and then someone proposed or tried to make an anomaly detection system. They never worked well. It’s an extremely difficult thing to get right. Better to just have good monitoring of whether your system is responsive/available/reliable and ways to quickly work out why it’s not.
[ Parent | on HN ]