The words contained in this file might help you see if this file matches what you are looking for:

...Problem set solutions exercise k t p amarkovchainxn startingfrom x has the transition probability matrix let inf n xn be rst time that process reaches state where it is absorbed if in some experiment we observed such a and noted absorption not taken place yet might interested conditional or given determine werstcalculate since know are thus twourns aandbcontainatotalofnballs assumethat at there were exactly balls an urn selected random proportion to its content i e with b then ball from q pandplacedinthepreviouslychosenurn determinethetransitionprobability for markov chain xt number of therearefourpossibilities picked receive give this occurs proba bility clearly absorbing you select gain likewise always but comes so no change above probabilities have kq also finally kp putting into gives considerthemarkovchainxn startingwith following determinetheprobability never visits because will eventually end up what wanttoknowiswhetherornottheprocessvisitsstatebeforethatpoint todothis stop by p...