Source: https://math.unice.fr/~diener/MAB06/Markov2.pdf