The paper deals with asymptotic stationarity of the process where is a vector in with non-negative coordinates, is an -valued process, S is a separable metric space and all operations in are meant in the coordinate-wise sense. It is shown that a type of asymptotic stationarity of (X, Y), together with some conditions, implies the same type of asymptotic stationarity of (w, X, Y). This result is applied to analyze asymptotic stationarity of multichannel queues. It may also be used to analyze asymptotic stationarity of series of multichannel queues.

One model of real-life spreading processes is that of first-passage percolation (also called the SI model) on random graphs. Social interactions often follow bursty patterns, which are usually modelled with independent and identically distributed heavy-tailed passage times on edges. On the other hand, random graphs are often locally tree-like, and spreading on trees with leaves might be very slow due to bottleneck edges with huge passage times. Here we consider the SI model with passage times following a power-law distribution ℙ(ξ>t)∼t-α with infinite mean. For any finite connected graph G with a root s, we find the largest number of vertices κ(G,s) that are infected in finite expected time, and prove that for every k≤κ(G,s), the expected time to infect k vertices is at most O(k1/α). Then we show that adding a single edge from s to a random vertex in a random tree 𝒯 typically increases κ(𝒯,s) from a bounded variable to a fraction of the size of 𝒯, thus severely accelerating the process. We examine this acceleration effect on some natural models of random graphs: critical Galton--Watson trees conditioned to be large, uniform spanning trees of the complete graph, and on the largest cluster of near-critical Erdős‒Rényi graphs. In particular, at the upper end of the critical window, the process is already much faster than exactly at criticality.

A planar graph contains faces which can be classified into types depending on the number of edges on the face boundaries. Under various natural rules for randomly dividing faces by the addition of new edges, we investigate the limiting distribution of face type as the number of divisions increases.

The asymptotic behaviour of the recursion is investigated; Yk describes the number of comparisons which have to be carried out to merge two sorted subsequences of length 2k–1 and Mk can be interpreted as the number of comparisons of ‘Simultaneous Merge–Sort'. The challenging problem in the analysis of the above recursion lies in the fact that it contains a maximum as well as a sum. This demands different ideal properties for the metric in the contraction method. By use of the weighted Kolmogorov metric it is shown that an exponential normalization provides the recursion's convergence. Furthermore, one can show that any sequence of linear normalizations of Mk must converge towards a constant if it converges in distribution at all.

We establish sufficient conditions for differentiability of the expected cost collected over a discrete-time Markov chain until it enters a given set. The parameter with respect to which differentiability is analysed may simultaneously affect the Markov chain and the set defining the stopping criterion. The general statements on differentiability lead to unbiased gradient estimators.

Each feasible transition between two distinct states i and j of a continuous-time, uniform, ergodic, countable-state Markov process gives a counting process counting the number of such transitions executed by the process. Traffic processes in Markovian queueing networks can, for instance, be represented as sums of such counting processes. We prove joint functional central limit theorems for the family of counting processes generated by all feasible transitions. We characterize which weighted sums of counts have zero covariance in the limit in terms of balance equations in the transition diagram of the process. Finally, we apply our results to traffic processes in a Jackson network. In particular, we derive simple formulas for the asymptotic covariances between the processes counting the number of customers moving between pairs of nodes in such a network.

This paper studies a mixed singular/switching stochastic control problem for a multidimensional diffusion with multiple regimes on a bounded domain. Using probabilistic partial differential equation and penalization techniques, we show that the value function associated with this problem agrees with the solution to a Hamilton–Jacobi–Bellman equation. In this way, we see that the regularity of the value function is $ \textrm{C}^{0,1}\cap \textrm{W}^{2,\infty}_{\textrm{loc}}$ .

Motivated by the study of the asymptotic normality of the least-squares estimator in the (autoregressive) AR(1) model under possibly infinite variance, in this paper we investigate a self-normalized central limit theorem for Markov random walks. That is, let {Xn, n ≥ 0} be a Markov chain on a general state space X with transition probability P and invariant measure π. Suppose that an additive component Sn takes values on the real line , and is adjoined to the chain such that {Sn, n ≥ 1} is a Markov random walk. Assume that Sn = ∑k=1nξk, and that {ξn, n ≥ 1} is a nondegenerate and stationary sequence under π that belongs to the domain of attraction of the normal law with zero mean and possibly infinite variance. By making use of an asymptotic variance formula of Sn / √n, we prove a self-normalized central limit theorem for Sn under some regularity conditions. An essential idea in our proof is to bound the covariance of the Markov random walk via a sequence of weight functions, which plays a crucial role in determining the moment condition and dependence structure of the Markov random walk. As illustrations, we apply our results to the finite-state Markov chain, the AR(1) model, and the linear state space model.

Let be an optional stochastic process and let be the directed set of almost-surely-finite stopping times. If lim , then

This equality is employed in studying the continuous-time gambler's problem, as formulated by Heath and Sudderth (1974). The optimal return function is shown to be upper semi-analytic and excessive whenever the utility function is Borel.

This paper studies the subexponential properties of the stationary workload, actual waiting time and sojourn time distributions in work-conserving single-server queues when the equilibrium residual service time distribution is subexponential. This kind of problem has been previously investigated in various queueing and insurance risk settings. For example, it has been shown that, when the queue has a Markovian arrival stream (MAS) input governed by a finite-state Markov chain, it has such subexponential properties. However, though MASs can approximate any stationary marked point process, it is known that the corresponding subexponential results fail in the general stationary framework. In this paper, we consider the model with a general stationary input and show the subexponential properties under some additional assumptions. Our assumptions are so general that the MAS governed by a finite-state Markov chain inherently possesses them. The approach used here is the Palm-martingale calculus, that is, the connection between the notion of Palm probability and that of stochastic intensity. The proof is essentially an extension of the M/GI/1 case to cover ‘Poisson-like’ arrival processes such as Markovian ones, where the stochastic intensity is admitted.

At times n = 0, 1, 2, · · · a Poisson number of particles enter each state of a countable state space. The particles then move independently according to the transition law of a Markov chain, until their death which occurs at a random time. Several limit theorems are then proved for various functionals of this infinite particle system. In particular, laws of large numbers and central limit theorems are proved.

We would like to correct the statement of Lemma 4.1 in [BDK+18].

A second-order heavy traffic approximation for the stationary waiting-time d.f. G for GI/G/1 queues is derived, the first-order term of which is Kingman's (1961), (1962a), (1965) exponential approximation. On the way to this result there are others of independent interest, such as a convolution equation relating this waiting time d.f. G with the d.f. of a related ladder height, an integral equation for G and some stochastic bounds for G. The main result requires a particular type of functional convergence that may also be of interest.

The forest of mutations associated to a multitype branching forest is obtained by merging together all vertices in each of its clusters and by preserving connections between them. (Here, by cluster, we mean a maximal connected component of the forest in which all vertices have the same type.) We first show that the forest of mutations of any multitype branching forest is itself a branching forest. Then we give its progeny distribution and we describe some of its crucial properties in terms of the initial progeny distribution. We also obtain the limiting behaviour of the number of mutations both when the total number of individuals tends to ∞ and when the number of roots tends to ∞. The continuous-time case is then investigated by considering multitype branching forests with edge lengths. When mutations are nonreversible, we give a representation of their emergence times which allows us to describe the asymptotic behaviour of the latter, under certain conditions on the mutation rates. These results have potential relevance for emergence of mutations in population cells, particularly for genetic evolution of cancer or development of infectious diseases.

This paper proposes and analyzes discrete-time approximations to a class of diffusions, with an emphasis on preserving certain important features of the continuous-time processes in the approximations. We start with multivariate diffusions having three features in particular: they are martingales, each of their components evolves within the unit interval, and the components are almost surely ordered. In the models of the term structure of interest rates that motivate our investigation, these properties have the important implications that the model is arbitrage-free and that interest rates remain positive. In practice, numerical work with such models often requires Monte Carlo simulation and thus entails replacing the original continuous-time model with a discrete-time approximation. It is desirable that the approximating processes preserve the three features of the original model just noted, though standard discretization methods do not. We introduce new discretizations based on first applying nonlinear transformations from the unit interval to the real line (in particular, the inverse normal and inverse logit), then using an Euler discretization, and finally applying a small adjustment to the drift in the Euler scheme. We verify that these methods enforce important features in the discretization with no loss in the order of convergence (weak or strong). Numerical results suggest that these methods can also yield a better approximation to the law of the continuous-time process than does a more standard discretization.

There is now a large literature on linkage disequilibrium between pairs of loci, both for selection in infinite populations and for neutral genes in finite populations, but there have been few studies with more loci. Bennett (1954) showed how the frequencies of chromosomes with any number of neutral genes would change in an infinite population, and the author (unpublished) has extended Bennett's results to find expected changes in chromosome frequencies with up to six loci in finite populations. For two linked neutral genes in finite populations the expected disequilibrium is zero, but the variance of the disequilibrium or the correlation of gene frequencies in segregating populations has been found. This has been done by Monte Carlo simulation (Hill and Robertson (1968)), but an approximation can be obtained by diffusion methods (Ohta and Kimura (1969)) and the asymptotic values using inbreeding theory (Sved (1971)). In this note we discuss the case of disequilibrium between three neutral loci and show how it relates to that between two loci.