Even for the aware, it is still easy to fall victim to curve fitting. I now go considerably out of my way to avoid it.
The first thing to do is divide the historical data into two non-contiguous parts. On one set you experiment (train) with your rules to find something worth validating. Then...