Could be that. What I meant was that you should have backtest you thing on say, 2009 (in sample) and then select your pairs and adjust your parameter values with that data. Then, with this, you backtest (out of sample) on 2010 data and see if it holds becaues it is that that you would have...