Re:Experts warn yearly checkups carry risks and do not reduc...
by travisjungroth on Monday April 03, 2023 @08:02PM
(#35433194)
I work in software A/B testing. We have similar problems.
The better filter and heuristics is using an algorithm that’s fit for anytime valid testing. The issue here is a high false positive rate. If you come up with all your treatment guidelines in an environment where you check every few hours and change it to every second, you’ve increased your samples by 3,600. Something like heart rate isn’t independent, but that’s still a lot.
You need to use a different algorithm (or algo at all) and/or relax the thresholds. Just random numbers, but if 45bpm was an alert before maybe it needs to be 50bpm.
The better filter and heuristics is using an algorithm that’s fit for anytime valid testing. The issue here is a high false positive rate. If you come up with all your treatment guidelines in an environment where you check every few hours and change it to every second, you’ve increased your samples by 3,600. Something like heart rate isn’t independent, but that’s still a lot.
You need to use a different algorithm (or algo at all) and/or relax the thresholds. Just random numbers, but if 45bpm was an alert before maybe it needs to be 50bpm.