Testing a system vs a randomised system is much better than simply looking for a positive expectancy, in much the same way as medical researchers measure the results of a double blind study using a new drug vs a placebo rather that just looking to see if patients get better on the new drug (they likely will get better without any drug).
The reason using randomised trades as your benchmark is better is because you can get a random system to make money if the market is good enough. So simply looking for a positive expectancy doesn't proove non random events.
Even forward testing has its drawbacks because market conditions can change between initial run and out of sample runs.
If you want to determine whether a system has an edge over random then 'Acrary' has already done very good work on this and posted a lot on it, why re-invent the wheel.
The reason using randomised trades as your benchmark is better is because you can get a random system to make money if the market is good enough. So simply looking for a positive expectancy doesn't proove non random events.
Even forward testing has its drawbacks because market conditions can change between initial run and out of sample runs.
If you want to determine whether a system has an edge over random then 'Acrary' has already done very good work on this and posted a lot on it, why re-invent the wheel.
