Quote from DrChaos:
the preferred term now is "machine learning".
I would translate this to be reasonably sophisticated quantitative modeling which is oriented towards Bayesian type of probabilistic prediction, as opposed to classical hypothesis testing.
Compared with 'regular' statistics, the problems, data and underlying models often involve high degrees of freedom and nonlinearity, and thus results depend profoundly on the insight of the data analyst, model structure, explicit and implicit assumption. The "machine learning" part is an attempt to fit the parameters without overfitting noise; the "human learning" part of the problem is more important to success.
Also success functions are also "soft" in the sense of somewhat better some of the time is OK.