@cunparis,
Insightful comments regarding backtesting. I paid that tuition, too. Trying to get that ideal parameter optimization
That was an expensive lesson for me (more in time than in P&L).
Now, I take different approach to backtesting. I try to gauge the parameter sensitivity and then find a plausible value within the range where the parameter works. I don't care if it the version I run live doesn't backtest as well as another version. I'm more concerned that it's robust enough to hold up out of sample.
Personally, I think the backtesting tools given to retail are there to give them hope and keep them trading. Without backtesting many rational people would figure out that they have no edge and drop out sooner but backtesting always gives them hope that they've come up with some magic rule/indicator set.
I don't agree that all systems fail. I think that all rule-based and indicator-based systems WILL fail though. Also, I think that good systems CAN fail b/c the trader fails to account for parameter evolution over time. That's actually my biggest concern right now, getting a firm grasp on the parameter evolution over many years.
Where's your blog. I'll check it out.
-bluelou
Insightful comments regarding backtesting. I paid that tuition, too. Trying to get that ideal parameter optimization
That was an expensive lesson for me (more in time than in P&L). Now, I take different approach to backtesting. I try to gauge the parameter sensitivity and then find a plausible value within the range where the parameter works. I don't care if it the version I run live doesn't backtest as well as another version. I'm more concerned that it's robust enough to hold up out of sample.
Personally, I think the backtesting tools given to retail are there to give them hope and keep them trading. Without backtesting many rational people would figure out that they have no edge and drop out sooner but backtesting always gives them hope that they've come up with some magic rule/indicator set.
I don't agree that all systems fail. I think that all rule-based and indicator-based systems WILL fail though. Also, I think that good systems CAN fail b/c the trader fails to account for parameter evolution over time. That's actually my biggest concern right now, getting a firm grasp on the parameter evolution over many years.
Where's your blog. I'll check it out.
-bluelou