News for hackers. Stuff that matters.
Re:Show HN: Heap is a new approach to analytics. Just captur... by dropdownmenu on Friday March 22, 2013 @02:22PM (#5424642)
Awesome idea to help make capturing data more easy, but how will you deal with the problem of the curse of dimensionality? As you start to capture more variables you data begins to appear far apart leading to less meaningful results.

Also, while 'capturing everything' sounds like an awesome idea it can lead to worse performance if you don't take into account that your data now has more variables that can each introduce noise.

Re:Show HN: Heap is a new approach to analytics. Just captur... by disgruntledphd2 on Friday March 22, 2013 @02:57PM (#5424865)
The thing about the curse of dimensionality is that it only really kicks into play when you try to put every variable into a model (or when you have low n relative to p, generally). If you restrict yourself to analysing events that you actually care about, its much less of an issue.
Re:Show HN: Heap is a new approach to analytics. Just captur... by matm on Saturday March 23, 2013 @03:37AM (#5427552)
"Capture everything" need not imply "measure everything." It should imply "measure anything you need to, immediately and retroactively".