Lectures - 8.2 Basic Properties of Markov Chains

Quiz 8.2 #1

Peter's transition matrix:

transition matrix

With state 1 being pizza and state 2 being hot dog, what is the probability that he will eat pizza this week given that he ate hot dog 3 weeks ago?