The asymptotic behaviour of the cumulative mean of a reward process 𝒵ρ, where the reward function ρ belongs to a rather large class of functions, is obtained. It is proved that E𝒵ρ (t) = C 0 + C 1 t + o(1), t → ∞, where C 0 and C 1 are fully specified. A section is devoted to the dual process of a semi-Markov process, and a formula is given for the mean of the first passage time from a state i to a state j of the dual process, in terms of the means of passage times of the original process.

A homogeneous Gaussian Markov lattice-process model has a regression coefficient that determines the extent to which a random variable of a vertex is dependent on those of the neighbors. In many studies, the absolute value of this parameter has been assumed to be less than the reciprocal of the number of neighbors. This condition is shown to be necessary and sufficient for the existence of the Gaussian process satisfying the model equations under some assumptions on lattices using the notion of dual processes. We also give examples of models that neither satisfy the condition imposed on the region for the parameter nor the assumptions on lattices. A formula for autocovariance functions of Gaussian Markov processes on general lattices is derived, and numerical procedures to calculate the autocovariance functions are proposed.