Quote from Swan Noir:
This thread has all the elements that an intellectual discussion should have including civility. I hope I can add to what you guys have already built.
I believe a huge chunk of human behavior is not only predictable but is among the most predictable of variables in the equations we calculate to live our lives.
On the most simplistic level if a human being's hand should touch the hot surface of a stove his next action (reflexive or not it is behavior) is nearly 100% predictable. PREDICTABLE BEHAVIOR
On a slightly higher plane if you tell me where on the politic spectrum someone stands and he is at or near one of the extremes I can tell you how he reacts, votes, thinks and donates (if he does) on an astonishing wide range of issues in excess of 80% of the time and with many at the absolute extremes, I -- or you -- will hit or exceed 90%. PREDICTABLE BEHAVIOR
It needs to be noted that predicting whether or not he backs up his opinion by donating to political parties, candidates or causes is a much less certain(predictable) exercise. NOT PREDICTABLE BEHAVIOR.
Let's continue up the ladder and get into hard market intelligence. Let's consider a chart of a any security --stock, debt instrument or whatever -- that has been in a long decline, six months or longer, and that decline is unrelenting on the weekly chart yet looking at the daily chart we see it has gone into congestion a handful of times -- or more -- and that each time it has come out the bottom of that congestion (sometimes ticking a point or two above the congestion for a short period) with some conviction.
Trader X opens a short position as it comes out of congestion on the daily and trader Y initiates a long position at the same moment and in fact is the other side of X's trade.
In the eight weeks following these trades the security changes its previously predictable behavior pretty dramatically. Three times in the eight weeks the weekly chart shows advances. It no longer congests on the dailies at all. It is either swinging higher or lower but does not make even one of those regular "stops" it did in the proceeding months.
If I ask those reading this thread which of these two market participants is more likely to close his position everyone will come to the same conclusion. Trader X will close it without a second thought (if he had not closed it a week or three earlier) and trader Y might close it, might buy more or might think it is the perfect time to execute a sophisticated option strategy he read about last week online.
The reason X is so predictable and Y is not is simple. The question posed -- who will close out -- is a proxy for my asking which one of these guys is more likely to continue take risk when he looks at movement that has morphed from consistent to erratic.
Which one of these guys is likely to take dollars off the table when he no longer understands what is going on.
But ultimately I have asked which one of these guys is the better trader.
We can predict behavior and opine on each traders relative skill at trading from a very limited set of inputs and we can be right most of the time. And maybe 80% of the time.
The mantra of the numbers guys for many years has been that human behavior is sufficiently unpredictable we must either ignore it or not let it exert to great an influence on our calculations.
Of course others think they can tell me what I will have for dinner on Tuesday.
The reality is not only quite different but it can also be incredibly valuable. If one spends even three minutes doping out what type of behavior that relates to what we want to know then we can either predict or come to the conclusion, as Rumsfeld was fond of saying it is unkowable.
To tie this in to an earlier post of mine anyone who thought about whether heavy hitters on Wall Street would be wrecking havoc with the reliability of the inputs at a moment in history when tens of billions were on the table needs to be ashamed of themselves if it took them a whole three minutes to decide whether their behavior was predictable and EXACTLY WHAT THAT BEHAVIOR WOULD BE.
Much of the problems stem not so much from mathematics and the precision it enables, rather, the problems are due to lack of observable variables input to the system being modeled. TDOG (inadvertently?) stumbled upon a good pragmatic maxim, in that generalization is more important than precision when looking forward. An issue that is already being addressed by those who deal with these ideas from a modern approach.
Anyways, it is similar to physics, in that if you have a closed system and are given all of the external variables that influence that system's state, you can clearly define some model to predict the output of the system (kind of like Laplace's demon, for anyone who's interested). The key is "knowing" all of the input variables, i.e. having them be observable and extractable. The reality is no one knows all of the input variables; some know more than others. Therein, I believe lies the fly in the ointment to your type of discussion regarding predictability of human nature. On a large scale, unless you are privileged to observable precise information regarding the 'cause', your estimation of the 'effect' will be contaminated by noise. Thus, we refer to simpler and more general models to try to extract some of the true signal that is drowning in a sea of noise.
This is also the basis for much of AI. Regarding the earlier poster, in some areas, AI has easily exceeded many professional experts in classification type problems. Something many would be wise to think about. Of course, the biggest problem I have encountered, is not so much the I/O and mathematical processing, but finding and selecting the variables and relationships which are useful to process (and there are a myriad to choose from). I.e. a major challenge in trading is simply explicitly defining the problem to be solved, which is perhaps, more difficult than actually solving it.
Regarding fat tails, they can be modeled and dealt with; hint: excessive leverage is not the key, unless you are implicitly guaranteed bailout, which is likely not the case for us less connected traders. But just because gaussian models are not an accurate representation, does not mean they should be thrown away. Fundamentals and classical knowledge should always come first; then be built upon.
2c