Quote from basis:
Frost, you're getting real knowledge now. It's not about your backtesting results.
Here's the lowdown on successful automated trading, which I've been doing successfully since 2002. You only need to know one thing.
*What's worth testing?*
It takes a very, very long time to figure that out. When you learn to ask the right questions, you simultaneously learn to interpret the answers. I've traded dozens of systems where performance declined as soon as I went live. Some of them I threw out, but others I stuck with, and some I even INCREASED capital in. I was able to do this because I knew what drove the systems' behavior.
I'm not going to give away too much, but I'll tell you this: when you look at code you've backtested, the more numbers in it, the less reliable it's going to be going forward. This is how you avoid overfitting. If you're using an x-period moving average, you're screwed. Likewise x-day highs, x-day RSI, stochs, you name it. You can get away with one or MAYBE two numeric parameters if you want stability. But again, you need a lot of knowledge / experience to know where those can go.
Last piece of info: systems decay. Markets change. Learn to figure out how far back to test something, and when your data set is no longer relevant. Right now I'd say if you're testing equity markets with data from pre-march 2003 you're hurting yourself.
You say that's just a bull market with low volatility? Yes, it is. And that's what we have right now. When it changes, use a different data set for testing. If you REALLY study, you'll know when it's changed.