The only SMALL problem I have is that I don't know how to program that well.
Of course a Black Swan event can happen and the 2007 economic crisis is one example.
The economic crisis was NOT a Black Swan event, not even for long term traders/investors. There was plenty of time to lighten up, hedge, or move into cash.
Even the Flash Crash of May 2010 was not a black swan event. The trend reversal unfolded gradually over a period of days and on the day of the crash there was a well-defined downtrend with no reversal signals and as each line in the sand (support level) was crossed the momentum built up until a capitulation move was underway (and by that point most retail trading platforms were locking up or lagging, so you couldn't even trade off it).
The closest thing to a black swan event you'll experience as an intaday scalper of CL is a gap that sometimes occurs when a major news release comes out.
Granted, there could be a huge terrorist attack that causes price to run lock limit, but that would truly be a Black Swan event for everyone in the market.
As for backtesting, manual backtesting not only works fine, it matched reality far better than the automated backtesting I tried. All the backtesting for my final trading plan was done manually and here's how I did it
once I had a set of basic rules:
> Scroll my chart(s) to the hard right edge at the time my trading day starts.
> Reveal one bar at a time until a valid setup appears.
> If a trade triggers per my rules, log the entry price and time.
> Manage the trade according to my core management rule (I start with one rule and include additional info on the spreadsheet as noted in the next step).
> Note the result (profit target or stop loss) and include additional columns for result if stop moved to b/e after N ticks favorable, MFE before price returns to entry price, MFE before price hits stop loss (unless an opposite position is signaled based on a new valid setup), and flexible S/R-based target.
I did many of these analyses with a fellow trader after the market closed, which provided a second set of eyes to ensure that every valid setup was attended to.
The additional data helped me develop filters which further honed an already positive expectancy plan. I then continued my daily manual bar-by-bar backtesting with the new filters/rules applied.
I also took screen captures of valid setups at the hard right edge (where excellent setups look scary as if there's no way there could be a profitable outcome) and I studied them constantly (while repeating the mantra, "Leap and the net will appear", lol!)
The choice is clear and I am working on it.
Foozler's comparison to a 12-step program is very apt for recovery from a poor mindset.
You say the choice is clear and you're working on it.
You have been working on it for a long, long time and guess what? It's not working.
You have seasoned traders here who are willing to act as your Higher Power and who can restore you to sanity. (What you're doing over and over again despite the fact that it isn't working is insanity.)
Turn your trading and your will (ego) over to one of these powers greater than yourself.
Read
The Disciplined Trader and use it as a framework for making a fearless, honest inventory of your bad trading habits and your defects of character in general.
Admit to yourself and your Higher Power (just post it all here on this journal) the exact nature of your bad habits and defects of character.
Then move forward with the hardest part of all:
Become humble and willing to do the work suggested to you by the Higher Powers here even if you believe it's boring, unnecessary, of little value, doesn't apply to you because somehow you're [different, better, smarter, unique, special].
If you do all this hard work and end up finding yourself in the coveted position of trading a positive expectancy plan appropriately for several days, weeks, or months, then you have to be forever on guard against the first lapse in discipline. Your equity curve early in the journal is a graphic example of what happens when you don't heed Pa(b)st's warning long ago here on ET:
“Being disciplined in the past isn’t good enough: on each and every trade you must be disciplined. Forever. Like a drunk in a program you can NEVER slip off the wagon.”