Quote from braincell:
That right there would be my answer to you. To not re-post my earlier posts i'll say i agree that TSL is being marketed to newbies and that some poor souls end up with a product they don't know how to use - because they lack the knowledge of statistics and a lot of other skills. However, with that knowledge, the fact that 80% of systems they find truly are curvefits (and i believe that), the other 20% that work out-of-sample on a statistically significnt portion of the data may just be an underlying market mechanism that was discovered. It all comes down to statistics, since you can claim there is still 0.05% chance that the system simply got lucky after 1000 good trades OOS, but that's a much lower risk compared to many others taken by traders on a regular basis. Of course, the statistical analysis is probably a major part of the game with such software(and should be undertaken very very seriously ), but the fact that the systems are composed of price derivations (indicators) and patterns which makes it an open white-box, allows you to see if it did in fact catch onto some mean-reversion logic or trend confirmation logic. These things are obvious to see, and a curve-fit system will often use an oscillator in the inverse way or do something that's obviously stupid and you'll know it's a curve-fit even before looking at OOS data.
I also agree that the way TSL is being sold is a minor crime, since the demos and the data presented on the site solely focus on the successul systems (the 20% or even 5% if you want to be a pessimist) that work OOS. Further, TSL has an erroneous way of counting filled limit/stop orders, no slippage, etc, further emphasising "good systems" that aren't really that good. On the newest EVORUN demos you can even see that the majority of systems in the OOS panel are squarely at around 0 net profit, going up and down around that value (if slippage and commission were used, they would mostly be negative). This is expected of curve-fitted and random systems and indicates a very low ratio of "valid" systems. When marketing TSL they don't tell you that. But what ultimately doesn't make TSL a complete fraud is the fact that with good analysis, in theory, you can find systems that have true underlying market dynamics in them. Considering it evolves 100s of systems per second, you're bound to find something after a few weeks of running the data. You can't deny this theory is valid.
As for the poster "milewski05" i got in touch with him via e-mail and checked him out. He's a real person and a real TSL user, i know that for sure.