News for hackers. Stuff that matters.
Re:Show HN: Stock recommender system using hedge fund data a... by melling on Saturday September 12, 2015 @01:23PM (#10208634)
Where's the fun in that? People have used math to make their fortunes.

https://en.m.wikipedia.org/wiki/D._E._Shaw_%26_Co.

https://en.m.wikipedia.org/wiki/Renaissance_Technologies

Aren't we all reading HN to learn?

Re:Show HN: Stock recommender system using hedge fund data a... by iheartmemcache on Saturday September 12, 2015 @03:17PM (#10208988)
Comparing Renaissance to any other firm is like comparing Berkshire-Hathaway to an average value-investment fund, or PIMCO to any other fixed income trading firm. James Simons (founder of Renaissance) was so smart he _co-founded a field of mathematics [differential co-homology] with Chern. Not only does the fund have a huge head-start (they were purely algorithmic trading in the 80s), but their commitment to academic pursuit over monetary gain is unparalleled. I.e., when asked who an ideal hire was for Renaissance, Simons said "anyone who has a PhD [in the applied or pure sciences, statistics, mathematics]" (you get a PhD because you love the field, you go to HBS or Wharton to make money).

These guys are trained professionals who've dedicated literally decades to graduate level pure & applied mathematics, and are simply of another a caliber. I can read JAMA all I want, quite fun indeed, but if I practice surgery, I'm certainly going to slice an artery. You have a better chance of going to Atlantic City and putting 100k on black than successfully making money in trading any set of securities, whether its Asian fixed-income, blue chip Wall Street equities, or CME pork belly futures. Just because you back-tested something successfully doesn't mean you should throw your hat into the ring, the sharks will bite till there's nothing left.

Re:Show HN: Stock recommender system using hedge fund data a... by melling on Saturday September 12, 2015 @05:12PM (#10209399)
I never said that it was easy or that it took a little math. I said that it has been done before and that we are here to learn.

I also can't figure out why I get all kinds of "it's really hard" and "be very afraid" comments on HN.

Re:Show HN: Stock recommender system using hedge fund data a... by mahyarm on Saturday September 12, 2015 @07:00PM (#10209686)
If you fuck up a computer, short of messing with BIOS voltage configurations, you can reset at no cost. It's near costless to make mistakes most of the time.

With finance, high voltage electronics, and explosive chemistry, you can have very high cost consequences if you screw up. And people often delude themselves in finance.

There is a also a return aspect in finance. You need a large amount of starting capital until 80hrs/wk of work will outpace what you make 80hrs/wk in your job.

For example, lets say you make $250k/yr as a smart engineer. We assume best case scenarios and say you make %10/APR (very generous) over the index fund return. You would need $2.5million in starting capital before you can start matching your working self in returns. Most people don't have $2.5 million lying around. You would get better returns starting a business or investing in yourself and leaving your savings into index funds.

Re:Show HN: Stock recommender system using hedge fund data a... by melling on Saturday September 12, 2015 @09:00PM (#10209962)
Once again I'm not asking for someone to explain the pros and cons of investing. Why do you insist on answering a different question?

Maybe I don't want to invest but simply want to understand how math is used to make trades without human decision making involved once the algorithms are written.

Re:Show HN: Stock recommender system using hedge fund data a... by srdev on Saturday September 12, 2015 @01:55PM (#10208739)
It takes more than a little math. I hang out in stock market chats that have a lot of programmer trying to do just this, and this comic is completely accurate: http://xkcd.com/1570
Re:Show HN: Stock recommender system using hedge fund data a... by ericjang on Saturday September 12, 2015 @03:27PM (#10209023)
I often wonder where Randall Munroe gets all his wisdom.
Re:Show HN: Stock recommender system using hedge fund data a... by ericjang on Saturday September 12, 2015 @06:26PM (#10209601)
edit: I didn't mean for this to be disparaging remark: I am genuinely impressed by how wise he is about so many topics, given that he is only 30 years old.
Re:Show HN: Stock recommender system using hedge fund data a... by w1ntermute on Saturday September 12, 2015 @01:55PM (#10208736)
And they've also used math to lose it: https://en.wikipedia.org/wiki/When_Genius_Failed
Re:Show HN: Stock recommender system using hedge fund data a... by saosebastiao on Saturday September 12, 2015 @02:30PM (#10208848)
I love the story of LTCM. It was pure mathematical hubris, but it was also amazing what they accomplished before they crashed. I mean 40% returns year over year for nearly 3 years wasn't just luck.

The crazy thing about LTCM, and the thing that everybody overlooks is that LTCM didn't die by bankruptcy...they died because of the systemic risk of their portfolio size and the subsequent intervention from the federal reserve. They had $100B under management, but only lost $5B in 4 months. It was a major catastrophe, sure, but it was only major because of the implications from its absolute size. A 5% drop in 4 months is something that can be recovered from on a personal portfolio level or even a small hedge fund level...but at LTCM's size it was endangering the financial system as a whole because it was threatening to bankrupt overleveraged institutional investors.

Jane Street Capital, while very opaque about what they do, has given me enough room to believe that LTCM has inspired a lot of their strategy. This always makes others perceive me as a quack that doesn't like history, but if another LTCM came around that was using the same strategy but on a much smaller scale and with a well spelled-out liquidation strategy, I would invest. In fact, I would probably bet big on it (>50% of my portfolio).

Nobody is gonna touch it though, because everybody is so conservative in finance. "We're gonna follow LTCM's strategy" isn't a sales pitch, it's a punch line. But outside of finance, there is a ton of precedent for monumental successes with an idea that has failed before. And I think LTCM is one of those ideas.

Re:Show HN: Stock recommender system using hedge fund data a... by zhte415 on Saturday September 12, 2015 @10:19PM (#10210127)
LTCM did make an important lesson that you imply, and existed before, but often wasn't adhered to: When you get to a certain size, close to new money.
Re:Show HN: Stock recommender system using hedge fund data a... by beagle3 on Saturday September 12, 2015 @02:17PM (#10208803)
Did you actually read the book?

The math people (Merton, Scholes) saw the craziness, pulled enough of their money out in time, and didn't lose it. The finance people (first and foremost Merriwether) were those who believed they are smarted than everyone and went bankrupt.

Re:Show HN: Stock recommender system using hedge fund data a... by w1ntermute on Saturday September 12, 2015 @06:06PM (#10209561)
I didn't say they understood the math they were using and lost it, I said they used math and lost it. Obviously if you always understand what is going on, you'll never find yourself up shit creek without a paddle.
Re:Show HN: Stock recommender system using hedge fund data a... by beagle3 on Sunday September 13, 2015 @01:34AM (#10210455)
And I ask again, since you linked to this book - did you read it? Or was it just "these guys failed, and they started out by using math, so ..." statement?

They did not use math at the time they lost money. They were were essentially gambling (doing "risk arbitrage", which is all risk and no arbitrage).

Re:Show HN: Stock recommender system using hedge fund data a... by sgt101 on Saturday September 12, 2015 @04:44PM (#10209308)
The bail out that underpinned the financial crisis; "calling all funds everywhere : we will cover your stupid mess, you cannot, will not lose." This, and flogging all the gold are the reasons to blame Gordon Brown for the current mess the UK's in.
Re:Show HN: Stock recommender system using hedge fund data a... by whatok on Saturday September 12, 2015 @11:57PM (#10210300)
To be clear, the Fed organized a private sector bailout of LTCM but did no taxpayer money was spent on it. Much different than the financial crisis.
Re:Show HN: Stock recommender system using hedge fund data a... by minimaxir on Saturday September 12, 2015 @01:28PM (#10208650)
"Math" is a little bit of an understatement.
Re:Show HN: Stock recommender system using hedge fund data a... by pvnick on Saturday September 12, 2015 @01:35PM (#10208677)
Get some money, download a historical EOD price data set, sprinkle in some math, et voila, riches!
Re:Show HN: Stock recommender system using hedge fund data a... by melling on Saturday September 12, 2015 @05:35PM (#10209464)
No, you need more data than that. You can watch this. Start at 11 minutes.

https://www.ted.com/talks/jim_simons_a_rare_interview_with_t...

Re:Show HN: Stock recommender system using hedge fund data a... by x5n1 on Saturday September 12, 2015 @01:37PM (#10208684)
Those days are gone, sonny. Now the market is pretty much completely rigged.
Re:Show HN: Stock recommender system using hedge fund data a... by hardwaresofton on Saturday September 12, 2015 @03:16PM (#10208983)
Yeah I don't think I agree with this. ETFs still net you quite a bit over a regular CD (or storing your money in your mattress), and are considered relatively predictable/safe
Re:Show HN: Stock recommender system using hedge fund data a... by tobylane on Saturday September 12, 2015 @01:42PM (#10208697)
By rigged do you mean most potential for profit is taken by robots in milliseconds, or rigged like a mass conspiracy to defraud the world?
Re:Show HN: Stock recommender system using hedge fund data a... by x5n1 on Saturday September 12, 2015 @01:46PM (#10208709)
The former, though the latter isn't that far fetched either.
Re:Show HN: Stock recommender system using hedge fund data a... by melling on Saturday September 12, 2015 @01:58PM (#10208748)
Yeah, but aren't you talking about pennies a share? How does this affect an trade that I'm going to hold for weeks or months?
Re:Show HN: Stock recommender system using hedge fund data a... by x5n1 on Saturday September 12, 2015 @02:01PM (#10208760)
"The answer I give them is that our markets are not rigged but are run/controlled/dominated by the flash boys/HFTs/machines that do not have the ability to think rationally but just trade on their algos and as a result you get absolute mayhem on days like today."

http://www.forbes.com/sites/jaysomaney/2015/08/24/is-our-sto...

Re:Show HN: Stock recommender system using hedge fund data a... by tedunangst on Saturday September 12, 2015 @03:10PM (#10208966)
And, uh, not to repeat the question or anything, but how does that affect a position held for weeks?
Re:Show HN: Stock recommender system using hedge fund data a... by melling on Saturday September 12, 2015 @02:33PM (#10208856)
Yes, always use a limit order. It looks like you can make some money on those big dips on crazy days.
Re:Show HN: Stock recommender system using hedge fund data a... by zhte415 on Saturday September 12, 2015 @10:20PM (#10210132)
IEX is an interesting option created by some pretty morally outraged characters.