Limit theorems for discrete-time Markov chains on the nonnegative integers conditioned on recurrence to zero

Limit theorems for discrete-time Markov chains on the nonnegative integers conditioned on recurrence to zero

0.00 Avg rating0 Votes
Article ID: iaor20002326
Country: United States
Volume: 12
Issue: 1
Start Page Number: 77
End Page Number: 102
Publication Date: Feb 1996
Journal: Communications in Statistics - Stochastic Models
Authors: ,
Keywords: ALOHA
Abstract:

We consider a discrete-time Markov chain X on the state space ℕ ≡ {0, 1, ...} with stationary one-step transition probabilities such that X is irreducible, transient, aperiodic and skip-free to the left. With X(m) denoting the modified Markov chain in which the states {m, m + 1, ...} are aggregated into a single absorbing state, we study the conditional state probabilities of X (resp. X(m)) at time n, given that state 0 will be reached some time after time n. A sufficient condition for the convergence, as n → ∞, of these conditional probabilities to a proper distribution is determined, as well as a condition under which the limiting conditional distribution of X is the limit, as m → ∞, of the limiting conditional distribution of X(m). For skip-free Markov chains we derive a necessary and sufficient condition for the existence of the limiting conditional distribution. As an example of a phenomenon which may be modelled by a limiting conditional distribution, we consider the backlog of a slotted ALOHA protocol.

Reviews

Required fields are marked *. Your email address will not be published.