Stable and scalable computation of state visitation probabilities in finite Markov chains

J Chem Phys. 2023 Jun 7;158(21):211103. doi: 10.1063/5.0154772.

Abstract

We report an algorithm based on renormalization to compute the probability that a particular state, or set thereof, is visited along the first passage or transition paths between two endpoint states of a finite Markov chain. The procedure is numerically stable and does not require dense storage of the transition matrix.