With backtester need pay attention to execution levels, so algos exec levels wont get much better than would be with incoming tick data and probably cant fully use last bar for simulation if on live it will be calculating on each incoming tick.I'm curious about ML, but for my current usage it seems too complicated. However, it might be interesting to use in the future, when I'm ready for it. Am more into creating a backtester and seeing how simple rules works on past data. This may sound trivial, but you can also test on data you haven't made the algo from, ie. other time periods, other instruments and markets. If something works generally, there's a bigger chance it's not just luck, maybeSo if interested, maybe search for backtesting on these forums? It's been mentioned, but not very easy to find info on it since it's a personal path of discovery that won't make much sense to anyone else.
I saw tremendous returns on first simple momentum based algo and automated parameter search implementation, then started to see it has to be too good to be true and it only found flaws, after making test conditions harder it got more realistic and most momenutm based algos tested have month of gaps on out of sample data or dont even break even.
Last edited: