Source: https://complex-systems-ai.com/wp-content/uploads/2018/12/MARKOV-PART1.pdf