Ok, but what kind of thing would you need to know? I agree with the out of sample easily becoming in sample, but what if I did not optimize again after trying the out of sample? Something like 1000 points in sample, 200 points out of sample?
Perhaps to improve I would randomize the selection of...