Re:How many medical studies are faked or flawed?
by muzani on Tuesday September 19, 2023 @07:40PM
(#37578597)
I used to work data entry as a research assistant, for some non-profit academia.
We saw flaws in the data collection - basically the people tasked to collect data were being lazy and some were making stuff up. We know the made up stuff when we see it. Outliers are fine and some groups do better than expected, but an entire group from one data collecter shouldn't be 100% outliers.
But we had to enter the data anyway. We were told to smooth the bad data to what was expected. So the outliers that were low were smoothed high, the high outliers were left alone because they seemed right. But those of us who were spending hundreds of hours on data entry had an intuitive feel of what an outlier looked like.
IMO everything should have been entered as is and the computer data would just be filtered out if it was deemed from a corrupt source. But the data in the computer was biased to match what the research wanted to prove.
So I agree that non-profits can be corrupt too, just because of the incentives each part of the way. We were being paid about half a cent per column of data. So some assistants were lazy and filling in data that could be right, or skimming on fields like address which are longer and less likely to be flagged.
We saw flaws in the data collection - basically the people tasked to collect data were being lazy and some were making stuff up. We know the made up stuff when we see it. Outliers are fine and some groups do better than expected, but an entire group from one data collecter shouldn't be 100% outliers.
But we had to enter the data anyway. We were told to smooth the bad data to what was expected. So the outliers that were low were smoothed high, the high outliers were left alone because they seemed right. But those of us who were spending hundreds of hours on data entry had an intuitive feel of what an outlier looked like.
IMO everything should have been entered as is and the computer data would just be filtered out if it was deemed from a corrupt source. But the data in the computer was biased to match what the research wanted to prove.
So I agree that non-profits can be corrupt too, just because of the incentives each part of the way. We were being paid about half a cent per column of data. So some assistants were lazy and filling in data that could be right, or skimming on fields like address which are longer and less likely to be flagged.