Last time, we saw how the next stage is developed from the current stage using the probability matrix.
X1 = P X0
There is a reason why it is called the Markov chain. The system we have developed can now predict the stage after the next stage, i.e., X2. Multiply the probability matrix with X1.
X2 = P X1
Substituting for X1,
X2 = P P X0
X2 = P2 X0
or in general
Xn = Pn X0
Let’s work out the stage after 10 moves and plot and see where A ends up.