Re:The Limits of Science
by dariosalvi78 on Wednesday October 23, 2019 @07:46AM
(#21333567)
> Given any big amount of data you are going to find something that fits
Exactly, and that's the main problem at the base of all "data mining": it is probable that you will find a model that will only work with your data. Take a step outside and everything falls. You are basically giving a formula to noise.
But often discoveries happen also by chance, so we shouldn't stop looking at unexpected patterns. However, once you find one, you should create a theory to explain it and setup a new experiment to confirm your theory.
If you can....
Exactly, and that's the main problem at the base of all "data mining": it is probable that you will find a model that will only work with your data. Take a step outside and everything falls. You are basically giving a formula to noise.
But often discoveries happen also by chance, so we shouldn't stop looking at unexpected patterns. However, once you find one, you should create a theory to explain it and setup a new experiment to confirm your theory. If you can....