Consider two different states i and j of a Markov chain. Which of the following choices can NEVER be true? O The long run probability of being in state i is 0. O The probability of going from state i to state i in 2 steps is 1. O The long run probability of being in state i is 1. O The probability of going from state i to state j in exactly 3 steps is strictly less than the first passage probability of going from state i to statej in exactly 3 steps.

Consider two different states i and j of a Markov chain. Which of the following choices can NEVER be true? O The long run probability of being in state i is 0. O The probability of going from state i to state i in 2 steps is 1. O The long run probability of being in state i is 1. O The probability of going from state i to state j in exactly 3 steps is strictly less than the first passage probability of going from state i to statej in exactly 3 steps.

Linear Algebra: A Modern Introduction

4th Edition

ISBN:9781285463247

Author:David Poole

Publisher:David Poole

Chapter3: Matrices

Section3.7: Applications

Problem 17EQ

See similar textbooks