Since you are on the topic of ML. Few in ML would approach testing in the
"tweak/test/fail, tweak/test/fail, tweak/test/fail, tweak/test/success! " approach to begin with.
There is something called cross-validation and generalization in the field that is very well known, and is the antithesis of...