Why do I see "Trends" in Randomly Generated Data?

Quote from danielc1:

This guy or girl will be the richest person on ET, if he or she isn't allready if it keeps going in that direction...

And I'm not kidding...

and for 99.95 in the back of my car i have a dvd trading system that has a 100% win rate and 4000% annual growth rate
 
Very interesting thread.
Why do I see "Trends" in Randomly Generated Data?
In random data you can see everything, including shapes of aminals, people, trends, chaos, lines, waves, see, and so on.
But it does not mean that these things does not exist.
This thread is just a thinking error.
:)
 
Quote from epetrov:

Very interesting thread.
Why do I see "Trends" in Randomly Generated Data?
In random data you can see everything, including shapes of aminals, people, trends, chaos, lines, waves, see, and so on.
But it does not mean that these things does not exist.
This thread is just a thinking error.
:)

Or does it?
 
Quote from nukethewhales31:

Or does it?

The only question that has practical value is "can a computer without human intervention be used to trade the market more profitably than human judgement?"

If it can the potential is trancendental. No sitting in front of multiple screens jumping around like a gerbil looking for the right combination of cute colored lines to trade.

Instead let the computers do the work.

The answer is Yes.
 
I took 10 minutes to write a simple program that I called "market generator".

It generates market data. The random process is this:

200 OHLC bars are generated.

For each bar a random number from 100 to 300 is selected (uniform distribution). This number is "number of ticks in the bar".

With the above number I then generate up and down ticks with 50/50 probability. I.e. chance of up tick = 0.5 and down tick = 0.5, so no bias.

Starting price is 100. One tick = 1.

In the attachment you can see a single simulation. This is random data. You can analyze, use TA and data-mine your ass off with it, but it is completely random and all patterns you will come up with will be meaningless bull crap.
 

Attachments

I can generate thousands of such "markets".

Here's the data of the above chart.


My next step is to bring in "more reality" :D Currently there are no gaps between bars. So the idea is this: add "night session" to generate gaps.
 

Attachments

Here I'm introducing "market generator" with gaps. The process is the same as above with a new feature of "gaps".

The process for generating gaps is simple:
It generates number of ticks from 0 to 15 from uniform distribution.

Then the number of ticks are generated to simulate "night session". That's it, this is a gap.


I love this chart. You can see "range-bound" market in like first 100 bars, then it "breaks out" to the upside. Oooh looky here, cup and handle pattern somewhere around bars 127-165 :D Then the "crash" and the "smooth up trend" :D

:D
 

Attachments

In case you want to feed the OHLC data of the above chart into some hardcore analysis tools, here's the data in the attachment.

Try fibonacci numbers, moving averages, oscillators, ACD, support and resistance lines, fitting ARCH model, try something more sophisticated, like neural networks and genetic algorithms.
 

Attachments

Quote from intradaybill:

One of the most scary thing in life is the abuse of logic. This is what you have done.

The conditional :

(random data) => trends

is true because one can demonstrate so like you did.

NOW, this is the tricky part, if you see trends in data and based on your demonstration above that corroborated the conditional you then claim that the data is random this is called:

AFFIRMING THE CONSEQUENT

which is a FORMAL logical fallacy and maybe the worse of its kind.
Example:

When it rains I wear a raincoat. Affirming the consequent is to say: I wear a raincoat therefore it rains.

All of the above is a simple way to say that random data include trends but the fact that markets also include trends CANNOT and DOES NOT imply the data are random.

Actually, the underline process of stock market data generation is for extended periiods of time very predictable and driven by macroeconomic conditions. In layman's or politician's terms, the stock markets reflect the state of the economy.

Bill

I'm stepping in to this thread a little late and this post is probably quite old. But it is quite interesting.

I agree with the asserion outlined above. But I also do not follow that assertion by then assuming that the markets are therefore not random.

I would expect that most would agree that the market is a complex and often highly chaotic system. So chaotic that noone up to now has been able to accurately model it - therefore it could be random). The issue I have with technical analysis tools (chart reading tools particularly) is that they are laughably simple methods of trying to model such a complex system. Every empirical study I'm aware of has shown that they do not work.

Consequently, I try to go with the algorithmic approach. Measurability and repeatability is what guides me rather than notional lines drawn on a chart. Also, I'm the kind of second guessing myself so automation helps save me from "me" - but that's a different story!


Thx
D
 
Quote from Jerry030:

The only question that has practical value is "can a computer without human intervention be used to trade the market more profitably than human judgement?"

If it can the potential is trancendental. No sitting in front of multiple screens jumping around like a gerbil looking for the right combination of cute colored lines to trade.

Instead let the computers do the work.

The answer is Yes.


Or is it?;)
 
Back
Top