The words contained in this file might help you see if this file matches what you are looking for:

...Content numerical solution for equilibrium equations of markov chain exact methods gaussian elimination and gth approximation iterative power method gauss seidel variant transient analysis process uniformization occupancy time m type models quasi birth death processes matrix geometric g free skip in one direction finite lecture algo discrete mc algorithmic finding the distribution chains introduction let denote a stochastic with states space property if satisfies it is then called stationary independent i e this case step transition probability from state to j where column vector ones element n represents go steps can be represented by diagram two communicate there route that joins them irreducible all its between each other an integer such three absorbing are denotes set written as identity expected number visits before absorption given starts at gives...