I have been using several optimizers like Adaptrade, stratagyquant
and Stratasearch and I bought GSB which is about the best and has very good OOS especially for ES. Adaptrade was useless, it has a mind of it's own and I could not get something usefull out of it.
To my surprise I have found good OOS performance running it on 430 bigger stocks of the SP500. I use a complex custom criteria formula only, so not all the rules with the weights and exclusions because my experience was that this did not work well. The systems that have a trade% of around 2%, a profit factor of more than 2 and a RRR of bigger than 2 and less than 20% drawdown and thousands of trades over 2002-2019 do work fine OOS in general and pass the covid crash well. The trades should not be much longer than 1-2 weeks.
I typically see the last 2 years OS (after testing 2002-2019) as much profit as the SP500 but with only 30 -50% in the market and with much lower drawdown. I also check for shifted (the S parameters for parameter stability) returns both by excluding and by having it in the custom criteria to find systems that have a broad area where they work even when parameters are shifted by +/-3.
I have bought a lot of software and was surprised to find a free software like Stratasearch that works quite good for me. When using SS on a single ticker it is difficult to avoid curvefit and I also find it performs bad OOS. I have put quite some time in it and have found out everything on my own.
If somebody could help me with old Stratasearch material like video or userforum material I would be happy to pay for that.
I also use Amibroker with an Elliotwave application from an Italian programmer and that has been very precise in predicting turning points in sectors. Running that ap on a sector and seeing which stocks all have wave 3's in several timeframes gives a precise indication.
I look for confirmation as broad as possible which is easy to do with the Amibroker explorer that shows the waves for all the stocks.
There was a backtester/optimizer called Stratasearch which is no longer around...You could throw in as many rules as you liked with money management,and it would run thru hundreds of thousands of permutations and of course curve fit...More often than not,the exact opposite of what I believed backtested better than the holy grails...And of course,when I walked it forward,it all fell to shit