Two-State Markov Chain Stationary Distribution

Stochastic Processes
Markov Chains
Medium
A Markov chain has transition matrix . Find its stationary distribution.
Hint 1

The stationary distribution satisfies and .

Hint 2

For a two-state chain, use the balance equation between the two transition rates.

Show worked solution
  1. 1. Set up the balance equation

    The detailed balance condition for a two-state chain gives , so .

  2. 2. Normalize

    Using together with the ratio gives the stationary distribution.

Answer: (0.6, 0.4)

Related roles: Browse quant jobs

Related problems