Consider a Markov chain with state space {1,2,3} and transition probabilities P13 = P21 = P32 = 0 and all other transition probabilities are 1/2. What is the long-run proportion of time that this chain spends in state 1? 1/3 1/2 It depends on which state the chain starts in. 2/3

Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter3: Matrices
Section3.7: Applications
Problem 12EQ: 12. Robots have been programmed to traverse the maze shown in Figure 3.28 and at each junction...
icon
Related questions
Question
Consider a Markov chain with state space {1,2,3} and transition probabilities P13 = P21 = P32 = 0 and all other transition probabilities are 1/2. What is the long-run
proportion of time that this chain spends in state 1?
O 1/3
1/2
It depends on which state the chain starts in.
O 2/3
Transcribed Image Text:Consider a Markov chain with state space {1,2,3} and transition probabilities P13 = P21 = P32 = 0 and all other transition probabilities are 1/2. What is the long-run proportion of time that this chain spends in state 1? O 1/3 1/2 It depends on which state the chain starts in. O 2/3
Expert Solution
steps

Step by step

Solved in 2 steps

Blurred answer
Recommended textbooks for you
Linear Algebra: A Modern Introduction
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Elementary Linear Algebra (MindTap Course List)
Elementary Linear Algebra (MindTap Course List)
Algebra
ISBN:
9781305658004
Author:
Ron Larson
Publisher:
Cengage Learning