Source: https://www.math-evry.cnrs.fr/_media/members/mfalconnet/chainemarkov2014.pdf