I'm pretty much a pure mechanical investor and been doing it for about 10 years now. I use the approach you're talking about. Develop a plan, backtest it, then work the plan.
You seem to be asking "what does it mean to backtest?"
In it's ideal form backtesting is developing a set of rules...