Why do I see "Trends" in Randomly Generated Data?

Quote from ProfLogic:

Your buddy's new namesake Benoit Mandelbrot has written a complete science you should read about called, "fractal geometry".

Mandelbrot found that price changes in financial markets did not follow a Gaussian distribution, but rather other Levy stable distributions, having theoretically infinite variance. He found, for example, that cotton prices followed a Levy stable distribution with parameter Á equal to 1.7, rather than 2 as in a Gaussian distribution. "Stable" distributions have the property that the sum of many instances of a random variable follows the same distribution but with a larger scale parameter.

One doesn't need to read the books or articles to see this work just research the process and lay the environment out in your charts to prove it to yourself. Of course this assumes you are able to perform this task and can first do the research.

In a nutshell . . . fractals bring order to random chaos.


funny! i see you never read mandelbrot completely. another evidence of the true believer only reading the scriptures that match beliefs and ignoring the ones that do not.

:D
 
Quote from dtrader98:



If you anti random walk posters want to use a name to back up the non-random walk, potential predictability arguments, use A. Lo and variance scaling ratio tests, not mandelbrot.

I

Are you maintaining that it is impossible to use any means to
predict a future event in market behaviour?
 
Quote from Corey:

Can you post in which books he discusses these topics? I would be very interested in reading them!

http://www.amazon.com/Mis-behavior-Markets-Benoit-Mandelbrot/dp/0465043550

http://www.amazon.com/Fractals-Scaling-Finance-Benoit-Mandelbrot/dp/0387983635/ref=pd_sim_b_title_1

I do not advocate blindly following the writings of anyone, just to let you know. I do advocate taking the information they provide and formulating an environment where you personally can verify and confirm either the usefullness or uselessness of that information. If you personally can not find value in ANY informtion, it is worthless to YOU and that is all that counts in the end.

Some of the structural information Mandelbrot talks about is quite useful in creating trading charts. Other information he discusses is marginal. You won't know until you apply it or research it.
 
Quote from dtrader98:

It never ceases to amaze me how many posters use mandelbrots name as some type of evidence that random walk proponents must be wrong because even the mighty mandelbrot showed that fractals are self-similar and chaotic, therefore, there is some underlying order to the markets that advanced mystics can see.

If anything, mandelbrot was saying markets are worse than gaussian random, attacking gausssian modelers because their view had too much order!
If you want to know what mandelbrot actually said about TA, he quoted that "patterns are the fool's gold of the financial markets. .. They are the inevitable consequence of the human need to find patterns in the patternless." I'm sure he also meant that towards looking for visual correlations in fractals on different time scales. Just because they are self similar does not mean that one instance predicts the behavior of another in the future. Mandelbrot is definitely far more on the side of the unpredictable camp than the visual palm readers.

If you anti random walk posters want to use a name to back up the non-random walk, potential predictability arguments, use A. Lo and variance scaling ratio tests, not mandelbrot.

I think it's pretty clear that most of the posters on this thread understand, that when we say the markets are random vs. deterministic, we are not limiting the definition of random to a gaussian distribution. The uniform coin toss is a very simple model that drives the visual point home for those who do not understand or are not yet aware of different types of random modeling.

You are absolutely correct. That is why I state that the structure of the fractals is what's important.
Mandelbrot's grasp on fractals is marvelous (I mean, he is the father) but his grasp of consistent application uses in charting applications is weak.
 
Quote from marketsurfer:

funny! i see you never read mandelbrot completely. another evidence of the true believer only reading the scriptures that match beliefs and ignoring the ones that do not.

:D

Read my response to Corey.

Someone like yourself that does blindly follow what he reads instead of doing your own research and testing can't fathom what can be gained by applying a variety of problem solving techniques.

These aren't actions of a "blind true believer" that is the action of someone that believes absolutely NOTHING until he can prove it to himself (me).

Unlike you, I ignore almost nothing, I likewise believe nothing till I can prove it, without a shadow of a doubt, to myself.
 
Quote from Jerry030:

Are you maintaining that it is impossible to use any means to
predict a future event in market behaviour?

All I can say is that the greatest minds and money have come up with systems to do just that (RAND corp for example). And over and over again they are wrong (very wrong).
There was the modern prediction corp, that created a neural net to predict markets. Although they were bought out and their results went private, if you read their book (the predictors) it shows that they had huge problems with very small scale errors in the data. This is the same as chaotic systems extreme sensitivity to initial conditions and divergence. The upshot is I doubt their system was even close to 100% predictable.

That being said, what you did was useful. You attacked it the way we should attack random data, you compared a mechanical system to one which is random. I showed you how to continue to test this to show it's validity. Far too many books out there that come up with great systems, only run them for 5 yrs or so (which is another form of cherry picking or curve fitting). Ultimately if your results are much greater than a monte carlo of random data (outside 95% confidence interval), then it is a worthy system to pursue and over time it could win. The most important part IMO is bet sizing, because as gaussian modelers know, the markets are not strictly gaussian and fat tail shocks do happen.

Now do I believe all participants have the same access to information and thus their edge is random? No Way.
Take a look at medallion. While they smile and tell all the cameras that they are studying moon cycles (TA disciples immediately see this as gospel), the reality (according to Belopolsky and Volfbeyn uncovered in a nasty lawsuit) is they are amongst other methods, reverse engineering POSIT order books, which violates security laws (as they are designed to keep institutions intentions invisible). I've made it a habit over the years to scratch beneath the surface, and try to find how winners really did it. However, you can take someone like zanger, who really did use pure TA and fundamentals, even massive leveraging and made a mint. I haven't seen anything that says he had an information edge. He happened to be in the right place at the right time and fortunately for him, didn't have any major fat tail events in the overall markets during that period. I haven't heard that much about his methods recently.

Lastly there are other variables to look at besides price that put the odds in your favor IMO.
 
Quote from MAESTRO:

A beautiful, crystal clear explanation! A very well articulated and explicit example of the deep understanding! I enjoyed it! Too many people are too complacent about their grasp of processes that occur in the market place. Too many illusions and perceived patterns! The most important and useful pattern that could be found in the historical data is the type of the distribution this data follows.

Thanks maestro. Always glad to hear your input and ideas.:)
 
http://www.bloomberg.com/apps/news?pid=20601109&sid=aHfkhe8.C._8&refer=home

``No self-respecting statistician in finance is using Gaussian statistics,'' interjects Lord John Eatwell, an economist and president of Queens' College at Cambridge University, who's sitting in the back. ``All models are Bayesian,'' he says, referring to the theory derived from 18th- century British mathematician Thomas Bayes that allows for data to be constantly added to calculate probabilities.

Taleb shoots back: ``Bayesian is necessary but not sufficient.''
 
Quote from Jerry030:

I make no assumption about the nature of the markets per se only that it is possible to correctly predict something about their future behavior, based on historical behavior with a level of accuracy that gives significant profit.
"Predictions about the future based upon similarities to the past are worthless"
Edward Allen Toppel
Zen in the markets
 
Quote from originalskunk:

"Predictions about the future based upon similarities to the past are worthless"
Edward Allen Toppel
Zen in the markets

Famous and infamous people make uninformed quotes all of the time.

640K ought to be enough for anybody… -- Bill Gates, 1981

A low voter turnout is an indication of fewer people going to the polls… -- Dan Quayle

Airplanes are interesting toys, but they have no military value… -- Marshal Ferdinand Foch in 1911

And there's no doubt in my mind, not one doubt in my mind, that we will fail… -- George W Bush

And what do you do?… -- Queen Elizabeth II, to four British guitar greats

Are you a guitarist, too?… -- Queen Elizabeth II, to Led Zeppelin's Jimmy Page

Are you Indian or Pakistani? I can never tell the difference between you chaps... -- Prince Philip

British women can't cook… -- Prince Philip

China is a big country, inhabited by many Chinese… -- Charles De Gaulle

Computers in the future may weigh no more than 1.5 tons… -- Popular Mechanics

Do not bother to sell your gas shares. The electric light has no chance… -- Professor John Henry Pepper

Do you have blacks, too?... -- George W Bush, to Brazilian President Fernando Cardoso

Do you still throw spears at each other… -- Prince Philip, to Australian Aborigines

Dontopedalogy is the science of opening your mouth and putting your foot in it... -- Prince Philip

Every prime minister needs a Willie… -- Margaret Thatcher, referring to Lord William Whitelaw

Everyone is at peace and happy and they all hop around from cloud… -- Britney Spears, on heaven

Everything that can be invented has been invented… -- Charles H Duell

Families is where our nation finds hope, where wings take dream… -- George W Bush

For every fatal shooting, there were roughly three non-fatal shootings… -- George W Bush

For NASA, space is still a high priority... -- Dan Quayle

Gaiety is the most outstanding feature of the Soviet Union… -- Josef Stalin

Have you been playing a long time?… -- Queen Elizabeth II, to rock legend Eric Clapton

How do you keep the natives off the booze long enough to pass the test… -- Prince Philip

Hurray, boys! We've got them. We'll finish them… -- General George Custer, before Little Big Horn

I admit it, I am not one of the great linguists… -- George W Bush

I am a person who recognizes the fallacy of humans… -- George W Bush

I believe there would be many people alive today if there were a death penalty… -- Nancy Reagan

I can do anything you want me to do as long as I don't have to speak… -- Linda Evangelista

I catnap now and then...but I think while I nap, so it's not a waste of time… -- Martha Stewart

I did not have sexual relations with that woman, Miss Lewinsky… -- Bill Clinton

I don't believe in black majority rule in Rhodesia…not in a thousand years… -- Ian Smith

I don't feel we did wrong in taking this great country away from them… -- John Wayne

I don't wake up for less than $10,000 a day… -- Linda Evangelista

I don't diet. I just don't eat as much as I'd like to… -- Linda Evangalista

I don't think about anything too much. -- Pamela Anderson

I feel my best when I'm happy… -- Winona Ryder

I get to go to lots of overseas places, like Canada… -- Britney Spears

I have determined that there is no market for talking pictures… -- Thomas Edison

I have opinions of my own, strong opinions, but I don't always agree with them… -- George W Bush

I know how hard it is to put food on your family… -- George W Bush

I know the human being and fish can coexist peacefully… -- George W Bush

I know what I believe. I will continue to articulate what I believe… -- George W Bush

I like most of the places I've been to, but I've never really wanted to go to Japan… -- Britney Spears

I loved Jordan. He was one of the greatest athletes… -- Mariah Carey, on death of King of Jordan

I never knew a guitar player worth a damn… -- Vernon Presley, to his young son Elvis

I promise you I will listen to what has been said here, even though I wasn't here… -- George W Bush

I recently met with the finance minister of the Palestinian Authority… -- George W Bush

I think anybody who doesn't think I'm smart enough to handle the job… -- George W Bush

I stand by all the misstatements that I've made... -- Dan Quayle

I think God is a giant vibrator in the sky...a pulsating force of incredible energy… -- David Arquette

I think that the film Clueless was very deep... -- Alicia Silverstone

I think there is a Trojan horse lurking in the weeds trying to pull a fast one… -- George W Bush

I think there is a world market for maybe five computers… -- Thomas J. Watson

I think war is a dangerous place… -- George W Bush

I think we agree, the past is over… -- George W Bush

I understand small business growth. I was one… -- George W Bush

I was asked to come to Chicago because Chicago is one of our 52 states… -- Raquel Welch

I wish I wasn't the war president. Who in the heck wants to be a war president… -- George W Bush

I'm not a very good novelist. But it'd make a pretty interesting novel… -- George W Bush

I've learned not to put things in my mouth that are bad for me… -- Monica Lewinsky

If a cricketer, for example, suddenly decided to go into a school and batter… -- Price Philip

If it has got four legs and it is not a chair, if it has two wings and it flies… -- Prince Philip

If the terriers and bariffs are torn down, this economy will grow… -- George W Bush

If this were a dictatorship, it would be a heck of a lot easier… -- George W Bush

If we do not succeed, we run the risk of failure… -- Dan Quayle

If you have intercourse you run the risk of dying… -- Cyndi Lauper

If you stay here much longer you'll all be slitty-eyed… -- Prince Philip

I'm also not very analytical. You know I don't spend a lot of time thinking… -- George W Bush

I'm much more than a pair of breasts… -- Pamela Anderson

I'm not going to have some reporters pawing through our papers… -- Hillary Clinton

I'm the commander - see, I don't need to explain… -- George W Bush

I'm the master of low expectations… -- George W Bush

In 1939 The New York Times said the problem of TV was that people had to glue their eyes...

It doesn't matter what he does, he will never amount to anything… -- Albert Einstein's teacher

It is clear our nation is reliant upon big foreign oil… -- George W Bush
 
Back
Top