News for hackers. Stuff that matters.
Re:Show HN: Quantblocks - Backtest your trading strategies by adg001 on Friday September 21, 2012 @06:44AM (#4553165)
A cautionary note on backtesting (ie, assessing how trading strategies would have performed over a historical period in time).

If an a posteriori probability distribution is a good fit for historical events, it doesn't mean in any way it is going to fit future data points. It may or may not.

Hence, use backtesting with care while trading.

Re:Show HN: Quantblocks - Backtest your trading strategies by theorique on Friday September 21, 2012 @08:56AM (#4553530)
Past performance may not be a guarantee of future performance, but it's all we've got to work with.
Re:Show HN: Quantblocks - Backtest your trading strategies by phreeza on Friday September 21, 2012 @09:55AM (#4553732)
There are more, statistically sounder methods that could be used to search the space of possible strategies, a la bootstrapping. These could be used to make more meaningful statements about the strategy, if the assumption is that previous statistics predict future statistics, which of course might also be false (black swans, etc.)

Given the vast amount of parameters that constitute a strategy, naive optimizing of the outcome of the strategy in the past is bound to produce overfitting in the majority of cases...

Re:Show HN: Quantblocks - Backtest your trading strategies by adg001 on Friday September 21, 2012 @10:15AM (#4553811)
Actually, this is not accurate. Before relying on our models, we get also the opportunity to validate them by checking at what extent they successfully predicts future data points.

Simply for the next t-time periods let the model give the user an estimate of the future prices/rates, together with an estimate of how accurate the model expects these predictions to be. This would allow the user to build confidence in the algorithm strategy she/he came up with, before employing it on the open market.

Re:Show HN: Quantblocks - Backtest your trading strategies by theorique on Friday September 21, 2012 @02:01PM (#4554872)
I mean it in the naive sense - we can observe the past but not the future. It definitely makes sense to paper trade a strategy and see its predictiveness in real time.
Re:Show HN: Quantblocks - Backtest your trading strategies by startuprob on Friday September 21, 2012 @06:53AM (#4553190)
Absolutely true, backtesting is not a guarantee of anything. That being said, I can't remember who said that "No model is perfect but some models are useful."
Re:Show HN: Quantblocks - Backtest your trading strategies by phreeza on Friday September 21, 2012 @07:24AM (#4553267)
"All models are wrong, but some are useful." George EP Box.

I put that quote on the front page of my masters thesis.

Re:Show HN: Quantblocks - Backtest your trading strategies by frinxor on Friday September 21, 2012 @07:01AM (#4553207)
this is great. love the design, and I can totally see a broker acquiring this so their clients will make more trades on their backtested-to-be-profitable strategies!
Re:Show HN: Quantblocks - Backtest your trading strategies by afarquhar on Friday September 21, 2012 @06:48AM (#4553177)
yep you're totally right, but hopefully it's still useful!