The relationship between backtest results with forward test at ATC 2012

 
  • 12% (6)
  • 10% (5)
  • 31% (16)
  • 12% (6)
  • 14% (7)
  • 22% (11)
Total voters: 40
 
So far, no one choice linear relationship. What do you think about that? Does it mean no body believe to back test results?
 
achidayat:
So far, no one choice linear relationship. What do you think about that? Does it mean no body believe to back test results?

For me the big mistake in using backtesting is choose the wrong methodology.

It is easy to find the ideal simulation from the past, hyper optimized, that will never happen again.

Poorly designed tests serve only to leverage dreams ;-)

 
figurelli:

For me the big mistake in using backtesting is choose the wrong methodology.

It is easy to find the ideal simulation from the past, hyper optimized, that will never happen again.

Poorly designed tests serve only to leverage dreams ;-)

Hyper optimized .... hmmm I know that. If so, is hyper optimization not advisable to obtain a suitable parameter values​​? What do you recommended to do optimization?
 
achidayat:
Hyper optimized .... hmmm I know that. If so, is hyper optimization not advisable to obtain a suitable parameter values​​? What do you recommended to do optimization?

Good question!

In my opinion, market future is allways unpredictable and there is no magic solutions, but change and adjust the strategy and good tests methodologies can make it more predictable, if we can say it. 

For example, supose a simple strategy of two moving averages crossing. Backtesting can be exciting, but hardly the performance will repeat, and the ideal is to use other filters and forward testing to double check.

Another way (that I like too much) is use random factors to several parameters, like Execution Random Delay option in Strategy Tester. In our company we use some libs to generate similar random factors to filter "hyper optimized" setups.

 
As stated in conclution of news : Optimization vs Reality : Evidence from ATC 2011

"The Expert Advisors that were successful in the Strategy Tester, showed good results during the competition"

I personally agree with that.

So let's wait and see, whether it also will happen in the ATC 2012.

Optimization VS Reality: Evidence from ATC 2011 - Automated Trading Championship 2012
  • championship.mql5.com
You want it, you've got it! After the publication of the article
Reason: