An invariant subspace approach in M/G/1 and G/M/1 type Markov chains

An invariant subspace approach in M/G/1 and G/M/1 type Markov chains

0.00 Avg rating0 Votes
Article ID: iaor20002560
Country: United States
Volume: 13
Issue: 3
Start Page Number: 381
End Page Number: 416
Publication Date: Aug 1997
Journal: Communications in Statistics - Stochastic Models
Authors: ,
Keywords: M/G/1 queues
Abstract:

Let Ak, k ≥ 0, be a sequence of m × m nonnegative matrices and let A(z) = ∑k=0 Akzk be such that A(1) is an irreducible stochastic matrix. The unique power-bounded solution of the nonlinear matrix equation G = ∑k=0 AkGk has been shown to play a key role in the analysis of Markov chains of M/G/1 type. Assuming that the matrix A(z) is rational, we show that the solution of this matrix equation reduces to finding an invariant subspace of a certain matrix. We present an iterative method for computing this subspace which is globally convergent. Moreover, the method can be implemented with quadratic or higher convergence rate matrix sign function iterations, which brings in a new dimension to the analysis of M/G/1 type Markov chains for which the existing algorithms may suffer from low linear convergence rates. The method can be viewed as a ‘bridge’ between the matrix analytic methods and transform techniques whereas it circumvents the requirement for a large number of iterations which may be encountered in the methods of the former type and the root finding problem of the techniques of the latter type. Similar results are obtained for computing the unique power-summable solution of the matrix equation R = ∑k=0 RkAk, which appears in the analysis of G/M/1 type Markov chains.

Reviews

Required fields are marked *. Your email address will not be published.