For those who don't know, the OP's complaint is a good one, but is also reasonably met by the most basic sort of Times Series Decomposition methods. To wit:
Forecast = f[trend, annual, seasonal, [even daily], random] content. Your job as a data user is to weddle out the most of the systematic content, leaving the least: the *random* "unsystematic" content. Just not a big deal. Not a hard assignment. Not something not done all the time, in any multivariate context -- whether of weather, user data, cars-in-parking-lots, corn yields, or market prices.
Done every day, from Stats 201, to Ren. Cap......
{FWIW, there IS a real "data crime" going on out there, having do to with data stability and the recognition [or not!] of changes in data/serial correlation/etc over time. Most of those who wish to paint their work with "A.I." or "Machine Learning" glibly ignore these tenets, and end up with crappy results. It's a real thing, but not without its humor, either...} https://xkcd.com/1838/
Forecast = f[trend, annual, seasonal, [even daily], random] content. Your job as a data user is to weddle out the most of the systematic content, leaving the least: the *random* "unsystematic" content. Just not a big deal. Not a hard assignment. Not something not done all the time, in any multivariate context -- whether of weather, user data, cars-in-parking-lots, corn yields, or market prices.
Done every day, from Stats 201, to Ren. Cap......
{FWIW, there IS a real "data crime" going on out there, having do to with data stability and the recognition [or not!] of changes in data/serial correlation/etc over time. Most of those who wish to paint their work with "A.I." or "Machine Learning" glibly ignore these tenets, and end up with crappy results. It's a real thing, but not without its humor, either...} https://xkcd.com/1838/
Last edited: