Thanks, I remember reading that a while back.
I have to agree with there testing as far as single contract position sizing goes. The reason being, they want the tests to show primarily the accuracy of the trading signals, not how much money a system could make.
Generally if someone wants to make more money they just adjust the number of lots or shares by what they are comfortable with and they can ratchet up the total profits (or loses).
If they allowed vendors to submit systems with money management algorithms there would be no way to compare apples to apples any more as even a small edge when run with fixed fractional or optimal f would result in massive gains over a number of years, but a system trading a one lot s&p in 1990 might call for a 500 lot today, and that's not realistic.
The small portfolio criticism is valid but again some systems are designed for just particular markets. I mean the S&P is a countertrend market. Some guy that develops a trend following system is usually gonna design it for specific markets, those that tend to trend, if its traded in the S&P or Cattle or something its gonna get killed.
Having said that I did read somewhere that FT allows vendors some flexibility as to what markets FT tests on.
For example, aberration runs on about 30 mkts, for them to drop say Sugar and add copper to the results that are posted at FT, well that's obviously a problem.....especially if aberration just booked a 4 grand loss in sugar and just make a killing in a copper trade. So in short I'd have to agree with your post. i.e. Before you run anything you need to backtest it yourself as to "your individual needs and your risk psychology andyour financial situation".
Having said all that.....can you comment specifically with regards to the back issues of the magazine, are they a good source of information? do you subscribe? etc.
Thanks