In this paper, we solve exit problems for a one-sided Markov additive process (MAP) which is exponentially killed with a bivariate killing intensity $\omega(\cdot,\cdot)$ dependent on the present level of the process and the current state of the environment. Moreover, we analyze the respective resolvents. All identities are expressed in terms of new generalizations of classical scale matrices for MAPs. We also remark on a number of applications of the obtained identities to (controlled) insurance risk processes. In particular, we show that our results can be applied to the Omega model, where bankruptcy takes place at rate $\omega(\cdot,\cdot)$ when the surplus process becomes negative. Finally, we consider Markov-modulated Brownian motion (MMBM) as a special case and present analytical and numerical results for a particular choice of piecewise intensity function $\omega(\cdot,\cdot)$ .

In this paper, we study a fluid model with partial message discarding and early message discarding, in which a finite buffer receives data (or information) from N independent on/off sources. All data generated by a source during one of its on periods is considered as a complete message. Our discarding scheme consists of two parts: (i) whenever some data belonging to a message has been lost due to overflow of the buffer, the remaining portion of this message will be discarded, and (ii) as long as the buffer content surpasses a certain threshold value at the instant an on period starts, all information generated during this on period will be discarded. By applying level-crossing techniques, we derive the equations for determining the system's stationary distribution. Further, two important performance measures, the probability of messages being transmitted successfully and the goodput of the system, are obtained. Numerical results are provided to demonstrate the effect of control parameters on the performance of the system.

We study percolation and Ising models defined on generalizations of quad-trees used in multiresolution image analysis. These can be viewed as trees for which each mother vertex has 2d daughter vertices, and for which daughter vertices are linked together in d-dimensional Euclidean configurations. Retention probabilities and interaction strengths differ according to whether the relevant bond is between mother and daughter or between neighbours. Bounds are established which locate phase transitions and show the existence of a coexistence phase for the percolation model. Results are extended to the corresponding Ising model using the Fortuin-Kasteleyn random-cluster representation.

We consider two-dimensional Lévy processes reflected to stay in the positive quadrant. Our focus is on the non-standard regime when the mean of the free process is negative but the reflection vectors point away from the origin, so that the reflected process escapes to infinity along one of the axes. Under rather general conditions, it is shown that such behaviour is certain and each component can dominate the other with positive probability for any given starting position. Additionally, we establish the corresponding invariance principle providing justification for the use of the reflected Brownian motion as an approximate model. Focusing on the probability that the first component dominates, we derive a kernel equation for the respective Laplace transform in the starting position. This is done for the compound Poisson model with negative exponential jumps and, by means of approximation, for the Brownian model. Both equations are solved via boundary value problem analysis, which also yields the domination probability when starting at the origin. Finally, certain asymptotic analysis and numerical results are presented.

We study the limiting behaviour of large systems of two types of Brownian particles undergoing bisexual branching. Particles of each type generate individuals of both types, and the respective branching law is asymptotically critical for the two-dimensional system, while being subcritical for each individual population.

The main result of the paper is that the limiting behaviour of suitably scaled sums and differences of the two populations is given by a pair of measure and distribution valued processes which, together, determine the limit behaviours of the individual populations.

Our proofs are based on the martingale problem approach to general state space processes. The fact that our limit involves both measure and distribution valued processes requires the development of some new methodologies of independent interest.

The theory of epidemics has been formulated as a deterministic theory and as a stochastic theory. There has been little work, except for a recent paper by Bailey [1], on the transition between the two formulations. In this paper we present an alternate formulation to that of Bailey that leads to a perturbation method more easily extendible to higher orders.

Let N and M be positive integers satisfying 1≤ M≤ N, and let 0< p0 < p1 < 1. Define a process {Xn}n=0∞ on ℤ as follows. At each step, the process jumps either one step to the right or one step to the left, according to the following mechanism. For the first N steps, the process behaves like a random walk that jumps to the right with probability p0 and to the left with probability 1-p0. At subsequent steps the jump mechanism is defined as follows: if at least M out of the N most recent jumps were to the right, then the probability of jumping to the right is p1; however, if fewer than M out of the N most recent jumps were to the right then the probability of jumping to the right is p0. We calculate the speed of the process. Then we let N→ ∞ and M/N→ r∈[0,1], and calculate the limiting speed. More generally, we consider the above questions for a random walk with a finite number l of threshold levels, (Mi,pi) i=1l, above the pre-threshold level p0, as well as for one model with l=N such thresholds.

We study the asymptotic behavior of the tail probability of integrated stable processes exceeding power barriers. In the first part of the paper the limiting behavior of the integrals of stable processes generated by ergodic dissipative flows is established. In the second part an example with the integral of a stable process generated by a conservative flow is analyzed. Finally, the difference in the order of magnitude of the exceedance probability in the two cases is related to the dependence structure of the underlying stable process.

We present a stochastic algorithm which generates optimal probabilities for the chaos game to decompress an image represented by the fixed point of an IFS operator. The algorithm can be seen as a sort of time-inhomogeneous regenerative process. We prove that optimal probabilities exist and, by martingale methods, that the algorithm converges almost surely. The method holds for IFS operators associated with any arbitrary number of possibly overlapping affine contraction maps on the pixels space.

This paper is concerned with a discrete Markov process related to an underlying weighted graph. With this graph we associate an urn containing p types of balls which correspond to the p vertices of the graph, and such that the number of balls of each type is proportional to the weight of the related vertex. A drawing scheme from the urn is defined which leads to Markovian non-homogeneous transition probabilities. Many kinds of weighted graphs are found to have a strong convergence property; this is that the number of balls drawn from the urn at the end of any single draw converges in probability to the total number of balls in the urn, as this tends to infinity.

With the general convergence theory for branching processes as basis a special problem is studied. An extra point process of events during life is assigned to each realised individual, and the behaviour of the superposition of such point processes in action is studied as the population grows. With the proper scaling and under some regularity conditions the superposition is shown to converge in distribution to a Poisson process. Another scaling gives rise to a mixed Poisson process as limit.

Established weak convergence techniques for point processes are applied, together with some recent strong convergence results for branching processes.

This paper focuses on the analyticity of the limiting behavior of a class of dynamical systems defined by iteration of non-expansive random operators. The analyticity is understood with respect to the parameters which govern the law of the operators. The proofs are based on contraction with respect to certain projective semi-norms. Several examples are considered, including Lyapunov exponents associated with products of random matrices both in the conventional algebra, and in the (max, +) semi-field, and Lyapunov exponents associated with non-linear dynamical systems arising in stochastic control. For the class of reducible operators (defined in the paper), we also address the issue of analyticity of the expectation of functionals of the limiting behavior, and connect this with contraction properties with respect to the supremum norm. We give several applications to queueing theory.

We consider the N-oscillator system of the van der Pol type, which contains a small positive parameter ε multiplying the non-linear damping and the random disturbance. For a formulation of the output we take the solution X(t) = (Xi(t))i=1···,N of the system of 2N-dimensional stochastic differential equations. Rotating each component Xi(t) about the origin of the plane by an angle t, we find that on time scales of order 1/ε together with sufficiently large N each Xi(t) behaves as the equi-ultimately bounded solution of an equation of the McKean type admitting a stationary probability distribution.