Omniadisce

Applied maths 16.1: Markov chains

Lesson Advanced

Join free to take this lesson

Anyone can look around, but taking a lesson needs a free account. With one, your answers are checked step by step and your progress is saved, so you can stop and pick up where you left off on any device.

10 steps ยท about 18 min

By the end you can

  • Write a transition matrix and check that it is valid
  • Compute the probability of a state two steps ahead by adding up paths
  • Find the long-run (stationary) share of time in each state of a two-state chain
  • Find the expected time a chain stays in a state

Who it is for: You know conditional probability (lesson 5.2) and expected values (lesson 5.4).

The steps

  1. A guess first
  2. States and the transition matrix
  3. Two days ahead
  4. The long run
  5. Long-run share
  6. A valid transition matrix
  7. Rainy days
  8. How long a state lasts
  9. Average repair time
  10. Is it really Markov?

Discussion 0 comments

Log in to join the discussion.

× Enlarged view