Re:How Microsoft computer scientists and researchers are wor...
by patall on Wednesday September 21, 2016 @10:32AM
(#12548466)
Like the good old "chr1" == "1" problem? Well, yeah that’s true. But still I think we have those consortia in place, why do we need another authority. They just have to set (and somewhat enforce) the rules.
[ Parent
| on HN ]
Re:How Microsoft computer scientists and researchers are wor...
by dekhn on Wednesday September 21, 2016 @11:52AM
(#12549316)
It goes far beyond "chr1" = "1". There are many other fields with next-to-impossible to interpret data. The consortia have, at best, advisory roles, they cannot enforce any rules. And given an extensible file format, third parties are going to extend it with poorly defined/standardized data. Then the consumers have to harmonize the data. Data harmonization (or cleaning) it typically one of the bottleneck steps in applying machine learning at scale.