Source: https://www.imo.universite-paris-saclay.fr/~meliot/markov/markov_theory.pdf