News for hackers. Stuff that matters.
Re:Google Search Terms Can Predict the Stock Market by PaulHoule on Friday April 26, 2013 @11:15AM (#5613340)
Lots of people use the Dow precisely because it is a bad indicator. If they don't like the conclusion they get with something better, like the W5000 or the S&P500, they can try it again with the Dow for a "second opinion."

The whole methodology is a joke anyway. If you evaluate a huge number of search terms, some of them are going do better than others. So terms that might mean something ("debt") get mixed up with terms like ("color") that got lucky.

What you have to do is come up with one strategy that trains a classifier on the combined words, tunes it up with logistic regression and derives optimal trading actions from that. And you've got to factor in what you're paying to the broker and the market makers.

Re:Google Search Terms Can Predict the Stock Market by ISL on Friday April 26, 2013 @12:01PM (#5613624)
Relevant technical terms: 'look-elsewhere effect' and 'false alarm rate'

http://en.wikipedia.org/wiki/Look-elsewhere_effect http://en.wikipedia.org/wiki/False_positive_rate

There are more similar considerations. Statisticians have been very busy for the last century or so.

Re:Google Search Terms Can Predict the Stock Market by rubinelli on Friday April 26, 2013 @12:47PM (#5613888)
As my statistics professor liked to say, "Numbers are meek creatures. If you torture them long enough, they will say whatever you want to hear."
Re:Google Search Terms Can Predict the Stock Market by asperous on Friday April 26, 2013 @04:18PM (#5615198)
This is the key to the accounting profession
Re:Google Search Terms Can Predict the Stock Market by lmg643 on Friday April 26, 2013 @08:42PM (#5616317)
The DJIA is a "bad" index but it is highly correlated with the S&P 500. I'm including a link to a study looking at ~70 years of data which shows a 0.95 correlation coefficient between DJIA and SP500.

http://www-stat.wharton.upenn.edu/~steele/Courses/434/434Con...

So, while the methodology might be spurious (random search terms may give false positives) i don't think the use of the Dow vs SP500 is a key criticism.

Re:Google Search Terms Can Predict the Stock Market by Jabbles on Friday April 26, 2013 @11:55AM (#5613591)
Sometimes known as data dredging. https://en.wikipedia.org/wiki/Data_dredging
Re:Google Search Terms Can Predict the Stock Market by Tobu on Friday April 26, 2013 @07:03PM (#5616009)
This has led to some interesting neurological findings: Neural correlates of interspecies perspective taking in the post-mortem Atlantic Salmon

http://prefrontal.org/files/posters/Bennett-Salmon-2009.jpg via http://www.metafilter.com/85322/The-Wisdom-of-Salmon

An extreme example, illustrating a common mistake in the field. https://xkcd.com/882/ has the gist of it.

Re:Google Search Terms Can Predict the Stock Market by shirederby on Friday April 26, 2013 @10:18PM (#5616535)
The "Salmon study" was an illustration of the necessity of correcting for multiple comparisons in voxel-wise testing. The problem it's addressing isn't itself data dredging, based on the definition linked above on Wikipedia.

Uncorrected multiple comparisons are, of course, a big portion of the statistical dubiousness inherent it "data dredging"

Re:Google Search Terms Can Predict the Stock Market by someben on Friday April 26, 2013 @12:34PM (#5613790)
Logistic regression and other parametric, non-regularized linear learners tend to do poorly with NLP forecasting -type modeling. (They usually overfit.)
Re:Google Search Terms Can Predict the Stock Market by PaulHoule on Friday April 26, 2013 @01:43PM (#5614284)
You're right.

That's why you build another threshold-type learner and then apply logistic regression to convert the score produced by learner A into a probability score.

Then you can tune at the exact point of the precision-recall curve that maximizes business value.