In this paper a formula is derived for the probability density function of the lifetime for a system of identical units. The lifetime of the system is the sum of the lifetimes of the independent units when the units have lifetimes distributed independently by the law proposed by Birnbaum and Saunders (1969).

In the present work, some new maximal inequalities for nonnegative N-demi(super)martingales are first developed. As an application, new bounds for the cumulative distribution function of the waiting time for the first occurrence of a scan statistic in a sequence of independent and identically distributed (i.i.d.) binary trials are obtained. A numerical study is also carried out for investigating the behavior of the new bounds.

In this paper, we consider a single-server queue with stationary input, where each job joining the queue has an associated deadline. The deadline is a time constraint on job sojourn time and may be finite or infinite. If the job does not complete service before its deadline expires, it abandons the queue and the partial service it may have received up to that point is wasted. When the queue operates under a first-come-first served discipline, we establish conditions under which the actual workload process—that is, the work the server eventually processes—is unstable, weakly stable, and strongly stable. An interesting phenomenon observed is that in a nontrivial portion of the parameter space, the queue is weakly stable, but not strongly stable. We also indicate how our results apply to other nonidling service disciplines. We finally extend the results for a single node to acyclic (feed-forward) networks of queues with either per-queue or network-wide deadlines.

Pseudo cross-variograms appear naturally in the context of multivariate Brown–Resnick processes, and are a useful tool for analysis and prediction of multivariate random fields. We give a necessary and sufficient criterion for a matrix-valued function to be a pseudo cross-variogram, and further provide a Schoenberg-type result connecting pseudo cross-variograms and multivariate correlation functions. By means of these characterizations, we provide extensions of the popular univariate space–time covariance model of Gneiting to the multivariate case.

As a class of optimal stopping problems with monotone thresholds, we define the candidate-choice problem (CCP) and derive two formulae for calculating its expected payoff. We apply the first formula to a particular CCP, i.e. the best-choice duration problem treated by Ferguson et al. (1992). The recall case is also examined as a comparison. We also derive the distribution of the stopping time of the CCP and find, as a by-product, that the best-choice problem has a remarkable feature in that the optimal probability of choosing the best is just the expected value of the (proportional) stopping time. The similarity between the best-choice duration problem and the best-choice problem with uniform freeze studied by Samuel-Cahn (1996) is recognized.

We study weighted ensemble, an interacting particle method for sampling distributions of Markov chains that has been used in computational chemistry since the 1990s. Many important applications of weighted ensemble require the computation of long time averages. We establish the consistency of weighted ensemble in this setting by proving an ergodic theorem for time averages. As part of the proof, we derive explicit variance formulas that could be useful for optimizing the method.

We give a very general reformulation of multi-actor Markov decision processes and show that there is a tendency for the actors to take the same action whenever possible. This considerably reduces the complexity of the problem, either facilitating numerical computation of the optimal policy or providing a basis for a heuristic.

The goal of this paper is to provide formulae for the expectation and variance of the height and length of the ancestral recombination graph (ARG). While the formula for the expectation of the height is known (see, e.g. Krone and Neuhauser (1997)), the other formulae seem to be new. We obtain in particular (see Theorem 4.1) a very simple formula which expresses the expectation of the length of the ARG as a linear combination of the expectations of both the length of the coalescent tree and the height of the ARG. Finally, we study the speed at which the ARG comes down from infinity.

This work concerns Markov decision chains with finite state spaces and compact action sets. The performance index is the long-run risk-sensitive average cost criterion, and it is assumed that, under each stationary policy, the state space is a communicating class and that the cost function and the transition law depend continuously on the action. These latter data are not directly available to the decision-maker, but convergent approximations are known or are more easily computed. In this context, the nonstationary value iteration algorithm is used to approximate the solution of the optimality equation, and to obtain a nearly optimal stationary policy.

Spatial random graphs capture several important properties of real-world networks. We prove quenched results for the continuous-space version of scale-free percolation introduced in [14]. This is an undirected inhomogeneous random graph whose vertices are given by a Poisson point process in $\mathbb{R}^d$. Each vertex is equipped with a random weight, and the probability that two vertices are connected by an edge depends on their weights and on their distance. Under suitable conditions on the parameters of the model, we show that, for almost all realizations of the point process, the degree distributions of all the nodes of the graph follow a power law with the same tail at infinity. We also show that the averaged clustering coefficient of the graph is self-averaging. In particular, it is almost surely equal to the annealed clustering coefficient of one point, which is a strictly positive quantity.

The possibility that interspecific contest tactics might be able to stabilize two species predator-prey populations is investigated using a matrix model of the population. It is found that if the interspecific tactics have no influence on intraspecific encounters, the non-trivial equilibrium population composition is necessarily unstable. The result provides some insight into a reported instability of a predator-prey population with ‘stable' strategies.

A probabilistic predator-prey model is constructed using linked discrete-time branching-type processes. A necessary and sufficient condition for positive probability of survival of both populations is given.

We consider a supercritical branching Lévy process on the real line. Under mild moment assumptions on the number of offspring and their displacements, we prove a second-order limit theorem on the empirical mean position.

De Finetti’s optimal dividend problem has recently been extended to the case when dividend payments can be made only at Poisson arrival times. In this paper we consider the version with bail-outs where the surplus must be nonnegative uniformly in time. For a general spectrally negative Lévy model, we show the optimality of a Parisian-classical reflection strategy that pays the excess above a given barrier at each Poisson arrival time and also reflects from below at 0 in the classical sense.

Using random walk theory, we first establish explicitly the exact distribution of the maximal partial sum of a sequence of independent and identically distributed random variables. This result allows us to obtain a new approximation of the distribution of the local score of one sequence. This approximation improves the one given by Karlin et al., which can be deduced from this new formula. We obtain a more accurate asymptotic expression with additional terms. Examples of application are given.

We present two sufficient conditions for detection of optimal and non-optimal actions in (ergodic) average-cost MDPs. They are easily interpreted and can be implemented as detection tests in both policy iteration and linear programming methods. An efficient implementation of a recent new policy iteration scheme is discussed.

This study deals with the ruin problem when an insurance company having two business branches, life insurance and non-life insurance, invests its reserves in a risky asset with the price dynamics given by a geometric Brownian motion. We prove a result on the smoothness of the ruin probability as a function of the initial capital, and obtain for it an integro-differential equation understood in the classical sense. For the case of exponentially distributed jumps we show that the survival (as well as the ruin) probability is a solution of an ordinary differential equation of the fourth order. Asymptotic analysis of the latter leads to the conclusion that the ruin probability decays to zero in the same way as in the already studied cases of models with one-sided jumps.

Pairs trading is a trading strategy which is used very frequently in the financial industry. An investment opportunity arises when the spread between two assets, which historically have exhibited autoregressive behavior, deviates from its recent history. In this case, the investor takes a long position in the asset which is expected to outperform going forward and finances this by taking a short position in the other one. If the spread converges, the investor can close both positions to generate a profit. We model the spread between two assets as an Ornstein-Uhlenbeck process and assume a constant opportunity cost. We then study the optimal liquidation strategy for an investor who wants to optimize profit in excess of the opportunity cost. Including this cost is important from an applied perspective, as the performance of any investment is always evaluated relative to the performance of the opportunity set.

Exact expressions are developed for the nth order autocovariance structure of the telegraph wave, the integral of which defines a biased correlated random walk.