In flipping coins, is the probability of obtaining the particular sequence tail tail ... tail 100 times inferior to any other sequence of flipping coins 100 times ?<p>
Basically, a probability is :<p>
number of favorable outcomes<br>
------------------------------------<br>
number of possible outcomes<br>
<p>
Flipping one coin, the probability of obtaining tail is 1/2<br>
Flipping two coins, the probability of obtaining tail tail is (1/2)*(1/2)=1/(2^2)<br>
Flipping 100 coins, the probability of obtaining tail tail ... 100 times is 1/(2^100)<p>
By using the same reasoning the probability of obtaining tail head tail head ... tail head 100 times is exactly
the same than obtaining tail tail ... 100 times that is to say the probability doesn't take the order of sequence into account.
<br>So Probability concept, which is purely <b>mathematical</b>, is not enough to define the concept of <b>randomness</b>. In 1965 - after the concept of <b>Entropy</b> was introduced by <b>Shannon</b> - <b>Kolmogorov</b> defined the concept of <b>algorithm complexity</b> for a <u>finite bit of strings</u> so that a <b>random string</b> is <u>"incompressible"</u> in the sense that a <u>program</u> would have to be <u>expanded as the serie grows larger</u>. So Kolmogorov, the father of <b>probability axioms</b> in 1933, recognised their limit himself: the use of these <u>axioms</u> only relie on <b>logical correctness</b> - which is <u>purely mathematical</u> - not on their <u>relevance to physical phenomena</u>.
<br><b>Walter Shewart</b>, the father of <b>Quality Control</b>, remarked also - well before <b>Kolmogorov</b> - that it was necessary, for use in <u>real world</u>, to define a concept like <b>randomness</b> not only with <b>probability axioms</b> but also <u>operationally</u> by comparing with a <b>physical operation</b> like flipping coins. <b>Kolmogorov</b> somehow had the same idea than <b>Shewart</b> except that he wanted to use a <b>computer</b> or <b>algorithm</b> which is indeed a <b>physical operation or device</b>.
Probability FAQs (in construction):
http://www.econometric-wave.com/faqs/probability/home.html.html
Basically, a probability is :<p>
number of favorable outcomes<br>
------------------------------------<br>
number of possible outcomes<br>
<p>
Flipping one coin, the probability of obtaining tail is 1/2<br>
Flipping two coins, the probability of obtaining tail tail is (1/2)*(1/2)=1/(2^2)<br>
Flipping 100 coins, the probability of obtaining tail tail ... 100 times is 1/(2^100)<p>
By using the same reasoning the probability of obtaining tail head tail head ... tail head 100 times is exactly
the same than obtaining tail tail ... 100 times that is to say the probability doesn't take the order of sequence into account.
<br>So Probability concept, which is purely <b>mathematical</b>, is not enough to define the concept of <b>randomness</b>. In 1965 - after the concept of <b>Entropy</b> was introduced by <b>Shannon</b> - <b>Kolmogorov</b> defined the concept of <b>algorithm complexity</b> for a <u>finite bit of strings</u> so that a <b>random string</b> is <u>"incompressible"</u> in the sense that a <u>program</u> would have to be <u>expanded as the serie grows larger</u>. So Kolmogorov, the father of <b>probability axioms</b> in 1933, recognised their limit himself: the use of these <u>axioms</u> only relie on <b>logical correctness</b> - which is <u>purely mathematical</u> - not on their <u>relevance to physical phenomena</u>.
<br><b>Walter Shewart</b>, the father of <b>Quality Control</b>, remarked also - well before <b>Kolmogorov</b> - that it was necessary, for use in <u>real world</u>, to define a concept like <b>randomness</b> not only with <b>probability axioms</b> but also <u>operationally</u> by comparing with a <b>physical operation</b> like flipping coins. <b>Kolmogorov</b> somehow had the same idea than <b>Shewart</b> except that he wanted to use a <b>computer</b> or <b>algorithm</b> which is indeed a <b>physical operation or device</b>.
Probability FAQs (in construction):
http://www.econometric-wave.com/faqs/probability/home.html.html

.