Quote from StillStanding:
unfortunately papertrading or sim does not match real life. If I get filled on a buy at the bid in sim or paper does not mean I would get filled in real life trading.
This is an old thread, but Stillstanding's response above is critical to understand if you are going to use a simulator platform to evaluate trading methods.
Even the best platforms will usually give unrealistic fills. For example, let's say time and sales is used to trigger a simulated fill of a limit order. It could be that all that would have to happen to get the fill is that a trade would have to print at your limit price. But the print could be because of a market order that in real trading takes precedence over a limit order.
A more realistic way to fill the simulated trade would be to fill it when the quoted ask equals the limit price for a buy, or the quoted bid equals the limit for a sell. But the best, most realistic and conservative way to trigger a fill in simulated trading would be to only trigger a fill if the price trades through the limit price, because in real trading that is the only event that guarantees a fill (or should anyway).
Unfortunately, i don't know of any simulator platforms that don't give unrealistic fills or allow the user to easily specify what event will trigger a fill for a particular order type.
The Thinkorswim paper trade platform, for example, seems to fill a limit buy order when the bid reaches the limit price, and a limit sell order when the offer reaches the limit price -- just the opposite of the way it should work. It is very easy to make lots of money on paper scalping on such a platform, especially if you ignore commissions.
I don't know why trade simulators so often have this defect of giving unrealistic fills, but my guess is that brokers want to hook neophytes by making it seem easy to make money. As Arthur Levitt said in his book: "Take on the Street", "Your Broker is not Your Friend."