Quote from jcl:
I admit that I also don't really get the meaning of what you want to say. Do you think that automated strategies can not work? Or that they can not be tested? Or that they can not be walk forward tested? If so, how would you test them instead?
I think there is a confusion here with the word "forward test". I believe what you are doing is training your system on a rolling window of data, then running your model "forward" without retraining to check the performance on "future" data that hasn't been trained on. The "future" data of course is still past data for you, it's just that it is future data for the system.
I believe most people on this board don't call that forward testing. Forward testing to most checks two things:
1. performance of the model on a test set, i.e., data that the model hasn't been trained on
AND
2. performance of the system in real time with real slippage, real execution, and real commission.
I believe you are testing only the former not the latter. Often to test 2, people will still use a simulated account but running in real time -- for example the IB simulated account. Depending on the provider, these simulated accounts can be fairly realistic in terms of slippage. But the iron test is to run it with a live account with real money (small position sizes of course) to finally check everything.

