Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by causi on Tuesday February 15, 2022 @10:28AM
(#30347704)
What I found interesting is that his analysis did not pick up the (now strongly evidenced) degree of inaccurate reporting from India. Indications are that India's covid deaths are between six and seven times higher than reported yet it looks pretty good on the Benford chart.
[ Parent
| on HN ]
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by bena on Tuesday February 15, 2022 @10:36AM
(#30347844)
It really depends on how you're manipulating data.
If you're just making up numbers, Benford's law could pick it up (unless you're aware of Benford's law and create numbers to follow it).
However, if you're just counting a sixth of all deaths, then your numbers will follow whatever pattern they were following before, just lower across the board.
The general form of Benford's law also fails in situations where numbers are capped for some reason. You'll wind up with a strong grouping around that particular number.
All in all, Benford's law can never prove anything. At most, it can give a good reason to look into a situation.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by causi on Tuesday February 15, 2022 @11:04AM
(#30348268)
This is an excellent point.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by rossdavidh on Tuesday February 15, 2022 @10:41AM
(#30347905)
The CDC estimates that in the U.S., there are about 32 cases of undetected covid-19 for every 10 that are detected. That ratio (derived from testing of pregnant women, car crash victims, blood donors, etc.) was from before Omicron, when there was for a while a shortage of testing capacity. So, if the ratio in India is 60 to 10, while that is worse than in the US, it's not that much worse.
In any case, Benford's Law helps to detect fraud (made-up numbers), not necessarily just inaccuracy (a low detection percentage, for example).
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by sudosysgen on Tuesday February 15, 2022 @11:06AM
(#30348301)
They're talking about deaths, not cases. For a case to go unreported is one thing, for a death not to be is much worse.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by cogman10 on Tuesday February 15, 2022 @10:32AM
(#30347762)
From my coworkers in india, I think that India's reporting has been less to do with inaccuracy and more to do with their entire healthcare system just crumbling under the pressure of covid. Far too many people getting (and dying from) covid to accurately measure and capture the true impact. It was real bad.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by not2b on Tuesday February 15, 2022 @10:50AM
(#30348063)
Yes, lots of people died in rural areas and were buried without ever getting near a doctor in the Delta wave, so they weren't recorded.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by tootie on Tuesday February 15, 2022 @10:42AM
(#30347928)
Benford would likely detect manipulation, but not systemic underreporting. If they're just missing half the cases and accuracy is essentially arbitrary, then it probably wouldn't show up as violating Benford.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by ceejayoz on Tuesday February 15, 2022 @10:36AM
(#30347843)
Not saying India did this, but I would imagine someone aware of Benford's law could tweak numbers to look valid with it taken into account, right? The more folks talk about "I used Benford's law to spot malfeasance", the less useful it becomes.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by PennRobotics on Tuesday February 15, 2022 @11:48AM
(#30348985)
It depends how much the tweak implementer knows about Benford's law. If you look through the figures in the Appendix of https://econwpa.ub.uni-muenchen.de/econ-wp/othr/papers/0507/... , a lot of people get the first and sometimes second digit behavior right yet fail to properly falsify the less significant digits. Of course, this sort of analysis might fall apart once you've summed 20 or 40 or 300 days of data.
Re:I used Benford’s law to analyze Covid-19 in 113 countries...
by ajross on Tuesday February 15, 2022 @10:39AM
(#30347881)
Benford's law is sort of like the Bechdel test. It's trivial to evade if you know what algorithm for which to optimize; it's value is in demonstrating the surprising number of places where it fails.