Re:Most data isn’t “big,” and businesses are wasting money p...
by pfarrell on Sunday May 12, 2013 @10:38PM
(#5696889)
There are two ways to define BigData.
1. The accumulation, integration and analysis of a larger number of data sources.
2. A volume of data that presents challenges running analysis functions across them... Due to the limits of the tools available.
1 is fraught with the kind of statistical pitfalls that are mentioned in the posted article. 2 describes a set of problems and boundaries that are time sensitive. What was BigData in 2006 (to, say LiveJournal or Digg) may not longer hold. As a data engineer, its important to keep a skeptical eye on marketing and make sure we're delivering valuable solutions that increase the bottom line for our business, not just produce "ain't it cool" type correlations.
1. The accumulation, integration and analysis of a larger number of data sources.
2. A volume of data that presents challenges running analysis functions across them... Due to the limits of the tools available.
1 is fraught with the kind of statistical pitfalls that are mentioned in the posted article. 2 describes a set of problems and boundaries that are time sensitive. What was BigData in 2006 (to, say LiveJournal or Digg) may not longer hold. As a data engineer, its important to keep a skeptical eye on marketing and make sure we're delivering valuable solutions that increase the bottom line for our business, not just produce "ain't it cool" type correlations.