The book Moneyball talks about this. Well I thought it would be about baseball, but it was kind of about our ability to judge merit. It's hard even in a measurement driven sport like baseball. Sports are arguably the purist meritocracy, yet scouts were routinely missing on their evaluation of talent.