Let P = (pjk) be the transition matrix of an ergodic, finite Markov chain with no cyclically moving sub-classes. For each possible transition (j, k), let Hjk(x) be a distribution function admitting a ...
Journal of Applied Probability, Vol. 13, No. 2 (Jun., 1976), pp. 361-364 (4 pages) We give an expression for the expectation of max (0, S1, ⋯, Sn) where Sk is the kth partial sum of a finite sequence ...