It's easy to understand why this guy has all the beer money he needs. He is a master at sleight of hand, and here's why:
"Curiously, TFP does not predict the CLOSE of the S&P very well but is astonishingly good at predicting the OPEN! This opens up the novel idea of the "Night Trader", run the figures through TFP just before market close to get a prediction of tomorrow's open and take an appropriate position just before market close."
Of course, this is hooey. Why? Because his "projection" of the next day's open is based on the previous day's close, and if you look at his projections, the next day's open is almost always within two points of the previous day's close. The sleight of hand occurs because you're looking at the chart of the Open (predicted = RED, actual = BLUE), and the two lines seem to match perfectly most of the time. Then, you look at the next day's prediction and bang, it appears to nail the open almost every time. But in fact what you really need to do is look at the actual close in the upper left-hand chart and then compare that value with the prediction of the next day's open in the lower right-hand chart. Most of the time, there's hardly any difference.
Here's a sample table I did, incrementally adding each day of data one day at a time to test out the predictions in faux real-time.
(C) = Previous Day's Close
(P) = Predicted Open
Action is SHORT or LONG based on P compared to C
(O) = Actual Open
(N) = Net
01/21/03 (C) 903.10 (P) 902.00 SHORT (O) 904.70 (N) -1.60
01/22/03 (C) 888.50 (P) 890.90 LONG (O) 883.30 (N) -5.20
01/23/03 (C) 877.50 (P) 876.40 SHORT (O) 883.50 (N) -6.00
01/24/03 (C) 883.00 (P) 884.60 LONG (O) 882.00 (N) -1.00
01/27/03 (C) 860.30 (P) 860.20 SHORT (O) 853.50 (N) +6.80
01/28/03 (C) 847.30 (P) 848.50 LONG (O) 852.50 (N) +5.20
01/29/03 (C) 854.50 (P) 860.00 LONG (O) 849.90 (N) -4.60
01/30/03 (C) 860.70 (P) 861.50 LONG (O) 863.50 (N) +2.80
01/31/03 (C) 840.00 (S) 838.40 SHORT (O) 837.00 (N) +3.00
Total net during sample period = -0.60
Of course, the real absurdity of the program is the difference between the close and the predicted open that it generates. Here are the absolute values:
1.10, 2.40, 1.10, 1.60, 0.10, 1.20, 5.50, 0.80, 1.60
Average = 1.71
I'd like to meet the trader who is willing to stake an overnight position based on this average expectation while assuming the overnight risk. What happened in the two cases where the difference between close and predicted open was greater than 2.00, where the program should supposedly have the greatest predictive power? One would have lost -5.20 on the first trade and -4.60 on the second trade. Further, the prediction on 1/27 was just 0.10 off the close, not enough of a difference to trade but yet it turned out to be the biggest trade through pure luck.
Granted, the sample size presented here is small, but it's pretty clear what's happening here. I noticed that the Tomorrow's Financial Pages program was initially written in 1994 and then rolled out again in 2002. Looks like he hooked a new generation of suckers...
Here's your boy:
http://vader.brad.ac.uk/finance/SJShepherd.html
"Curiously, TFP does not predict the CLOSE of the S&P very well but is astonishingly good at predicting the OPEN! This opens up the novel idea of the "Night Trader", run the figures through TFP just before market close to get a prediction of tomorrow's open and take an appropriate position just before market close."
Of course, this is hooey. Why? Because his "projection" of the next day's open is based on the previous day's close, and if you look at his projections, the next day's open is almost always within two points of the previous day's close. The sleight of hand occurs because you're looking at the chart of the Open (predicted = RED, actual = BLUE), and the two lines seem to match perfectly most of the time. Then, you look at the next day's prediction and bang, it appears to nail the open almost every time. But in fact what you really need to do is look at the actual close in the upper left-hand chart and then compare that value with the prediction of the next day's open in the lower right-hand chart. Most of the time, there's hardly any difference.
Here's a sample table I did, incrementally adding each day of data one day at a time to test out the predictions in faux real-time.
(C) = Previous Day's Close
(P) = Predicted Open
Action is SHORT or LONG based on P compared to C
(O) = Actual Open
(N) = Net
01/21/03 (C) 903.10 (P) 902.00 SHORT (O) 904.70 (N) -1.60
01/22/03 (C) 888.50 (P) 890.90 LONG (O) 883.30 (N) -5.20
01/23/03 (C) 877.50 (P) 876.40 SHORT (O) 883.50 (N) -6.00
01/24/03 (C) 883.00 (P) 884.60 LONG (O) 882.00 (N) -1.00
01/27/03 (C) 860.30 (P) 860.20 SHORT (O) 853.50 (N) +6.80
01/28/03 (C) 847.30 (P) 848.50 LONG (O) 852.50 (N) +5.20
01/29/03 (C) 854.50 (P) 860.00 LONG (O) 849.90 (N) -4.60
01/30/03 (C) 860.70 (P) 861.50 LONG (O) 863.50 (N) +2.80
01/31/03 (C) 840.00 (S) 838.40 SHORT (O) 837.00 (N) +3.00
Total net during sample period = -0.60
Of course, the real absurdity of the program is the difference between the close and the predicted open that it generates. Here are the absolute values:
1.10, 2.40, 1.10, 1.60, 0.10, 1.20, 5.50, 0.80, 1.60
Average = 1.71
I'd like to meet the trader who is willing to stake an overnight position based on this average expectation while assuming the overnight risk. What happened in the two cases where the difference between close and predicted open was greater than 2.00, where the program should supposedly have the greatest predictive power? One would have lost -5.20 on the first trade and -4.60 on the second trade. Further, the prediction on 1/27 was just 0.10 off the close, not enough of a difference to trade but yet it turned out to be the biggest trade through pure luck.
Granted, the sample size presented here is small, but it's pretty clear what's happening here. I noticed that the Tomorrow's Financial Pages program was initially written in 1994 and then rolled out again in 2002. Looks like he hooked a new generation of suckers...
Here's your boy:
http://vader.brad.ac.uk/finance/SJShepherd.html
in practice you don't have to wait so long so the theory must be flawed. BUT EMH is a fuzzy concept, that is it is not true if it is confused with Random Walk as it was the case at the beginning. But since there were explicit evidence they just say well ok Random Walk cannot be BUT EMH can be without Random Walk
. Moreover there is not a very clear definition of Efficiency and entire book could be written just to try to define it : I bought a doctorate thesis that just talk about that