link:
http://www.elitetrader.com/vb/showthread.php?s=&threadid=24127&perpage=6&pagenumber=11
" Your posts have been enlightening - one of the reasons why I come to ET
Question for you (and the greater ET universe at large)
Different market environments have different dynamics, so a good BT should put a system through different blocks of time with pronounced dominant dynamics.
I can think of a few dominant dynamics :
bull market (1999)
bear market (2002)
congestation market (2002 Q4 to 2003 Q1)
trending market (1995)
panic events (1998, 1987)
low vol (2003 June to August)
(parathesis refers to S&P 500 time periods)
Would there be any other dynamic periods you would recommend for BT?
In the spirit of sharing general (non-specific) information to my fellow investigators of market structure, I'm going to attach the following excel model i've built to analyze S&P behaviour. Feel free to PM me.
--------------------------------------------------------------------------------
That's a nice sample. So if I had to backtest this sample, I would do so from 1998 to present. Then I would backtest those particular mentioned periods, from the start of the move to the end. Then I would backtest quarterly and yearly on a generic basis.
Now I have optimized those particular parameters. I would want to see some similarity in the optimized numbers. I would look through the optimization reports for such similarities. Again I assert that the highest win rate will not be the best number for the entire period.
Now I have some similarities in the optimized numbers. I backtest the entire data sample again. If I am net postive through the entire data sample, I have a robust system. If I do not, time to find some new indicators. I will keep the system if it out performs the buy and hold for the same period.
Finally, I do this method on every major time frame, which for me would be 1min, 2min, 3min, 5 min, 10min, 15min, 20min, 30min, 45min, 60min, and daily. Keep the best result.