Quote from lost dilettante:
Some further thoughts. I like to make models of systems to gain an understanding. Doing this it is possible make two simple models of the market.
1. A random-only model market. Imagine that the closing prices for every security is set by elves rolling dice. In this market the closing prices would be completely random and hence unpredictable (assuming the dice are unbiased). It would not be possible to gain an edge through any sort of fundamental analysis, but it would be possible to intraday trade against other traders. As long as you were able to outplay the other traders then you could make a profit. This is really a "poker" model where the fundamentals are random (ie like the order of the cards) and everyone is playing against each other. If the market is like this then most traders are really just playing a version of poker and I guess it is not surprising that so many successful traders like card games.
In this model issues like understanding the psychology of the market and "gut feel" become important. Success in this market is all about outplaying the other market participants. Thinking too much would be a major disadvantage because what is needed to succeed is to get inside the mind of the other traders. This is very hard to do if you don't think like the other players in the market - if the majority of players are average thinkers, then being a high level thinker will be a real handicap. The best players in this model would think just like the other players, but be slight faster or brighter. If this model accurately reflect the real market then it is not surprising that smart people come unstuck so often.
2. The predetermined market model. Imagine that the closing price is set by the number of degrees above or below the daily average the actual temperature was in Bismark, ND 3 days ago. In this market the closing price is totally predictable if you happen to know the average and actual temperatures in Bismark and you would have a perfect money machine. The problem faced here is not that the market is not 100% predictable, but in finding the cause. You could go data mining through all the past market data, find 100 or 1000 of rules that model the closing prices, yet when you go to use them they will all be wrong. If we assume this market is a zero sum game then most traders will fail, some will break even, and some will succeed fantastically, all of this by chance alone. The successful traders will fool themselves into think they have found an edge, when all they have done is be lucky. The key to success in this market is finding the cause, but when you are faced with the fact that data mining will find hundreds of false causes that pass back testing.
The actual market is obviously not an extreme like either of these models, but has some aspects of both. Over the long term prices are driven by fundamentals like earnings, but in the short term prices are driven by the "poker" traders. Given this is should be possible to play the market in one of two ways. 1) With a short term "poker" strategy focused on the other traders in the market, or 2) With a longer term strategy focused on identify the fundamental causes of price movement. The first strategy is better suited to an average player, while the second is better suited to a higher level thinking player.