Re:Experts warn yearly checkups carry risks and do not reduc...
by travisjungroth on Monday April 03, 2023 @08:02PM
(#35433194)
I work in software A/B testing. We have similar problems.
The better filter and heuristics is using an algorithm that’s fit for anytime valid testing. The issue here is a high false positive rate. If you come up with all your treatment guidelines in an environment where you check every few hours and change it to every second, you’ve increased your samples by 3,600. Something like heart rate isn’t independent, but that’s still a lot.
You need to use a different algorithm (or algo at all) and/or relax the thresholds. Just random numbers, but if 45bpm was an alert before maybe it needs to be 50bpm.
One solution would be to say “great! Let’s sample once an hour!” But surely one could come up with much better filters and heuristics.
Of course, doing this in an ethical way might be complicated.