Hey I've got a few comments and questions while on the topic of backtesting.
First off I want to say that in the begining backtesting as a useful tool made sense to me. As I started to try and understand the science behind market fluctuations I eventually came to the conclusion that back testing is not viable. I will say though that I've never met anyone who has proved to me that it does or doesn't work.
From a probabilistic point of view I read that it is not unlikely for a person to use indicators, mathmatical algorithms and statistics to find a way that backtests profitably. But the illusion here is that after so much time of adjusting parameters and values it is entirely possible to "custom fit" your system to past market data. This sort of "fit" is coincidence and has no correlation with new data. Have I tried this? No.
Secondly I was wondering if anyone has studied chaos theory and fractal geometry. To me this is very interesting. Aka sensitive dependence on initial conditions. A small signal can amplify into a totally unpredictable large output. I have yet to relate this to human emotions and market fluctuations but it seems as though as with the weather and its unpredictability the market may operate in a similar way. But unpredictability just doesn't seem like the right word. I know what a piece of wood looks like before looking at it even though the pattern of grain is unique in every piece. I know what market fluctuations look like and are going to look like even though I can't "predict" what will happen tomorrow. So what is it that I know? It seems that there is a non-linearity between back testing and market fluctuations. I guess I am trying to say that back testing is a known, predictive, defined pattern that repeats where market fluctuations do none of the above. The market may keep a certain "similarity" at all times but its never the same. How can they work in harmony?
I hope I am making some sort of sense. This is where I am at now and trying to make sense of it all.
-Ray
First off I want to say that in the begining backtesting as a useful tool made sense to me. As I started to try and understand the science behind market fluctuations I eventually came to the conclusion that back testing is not viable. I will say though that I've never met anyone who has proved to me that it does or doesn't work.
From a probabilistic point of view I read that it is not unlikely for a person to use indicators, mathmatical algorithms and statistics to find a way that backtests profitably. But the illusion here is that after so much time of adjusting parameters and values it is entirely possible to "custom fit" your system to past market data. This sort of "fit" is coincidence and has no correlation with new data. Have I tried this? No.
Secondly I was wondering if anyone has studied chaos theory and fractal geometry. To me this is very interesting. Aka sensitive dependence on initial conditions. A small signal can amplify into a totally unpredictable large output. I have yet to relate this to human emotions and market fluctuations but it seems as though as with the weather and its unpredictability the market may operate in a similar way. But unpredictability just doesn't seem like the right word. I know what a piece of wood looks like before looking at it even though the pattern of grain is unique in every piece. I know what market fluctuations look like and are going to look like even though I can't "predict" what will happen tomorrow. So what is it that I know? It seems that there is a non-linearity between back testing and market fluctuations. I guess I am trying to say that back testing is a known, predictive, defined pattern that repeats where market fluctuations do none of the above. The market may keep a certain "similarity" at all times but its never the same. How can they work in harmony?
I hope I am making some sort of sense. This is where I am at now and trying to make sense of it all.
-Ray
