If a trading algorithm is "trained" on 1000 stocks, and is afterwards "tested" on an additional 1000, the additional data is something the algorithm has not yet "seen." The first 1000 make the sample, the second 1000 make the "out-of-sample," and almost by definition the out-of-sample data is...