Keyword: markov processes

Found 1372 papers in total
An heuristic for multi-dimensional Markov decision processes
An heuristic for multi-dimensional Markov decision processes
1993,
An heuristic procedure is presented for multi-dimensional Markov decision processes...
Solving infinite-horizon discounted Markov games using a superharmonic least-element algorithm
Solving infinite-horizon discounted Markov games using a superharmonic least-element algorithm
1993,
This paper presents an algorithm for solving infinite-horizon discounted Markov games...
A new continuous-time search model
A new continuous-time search model
1991,
The paper studies a search model in which offers of random size are received randomly...
Opportunity-based block replacement
Opportunity-based block replacement
1991,
In this paper the authors consider a block replacement model in which a component can...
Optimality of the NVI adaptive policy for a partially observed Markov decision model
Optimality of the NVI adaptive policy for a partially observed Markov decision model
1991,
The production replacement process is modelled with partially observed Markov process....
An iteration method for reliability evaluation of a fleet system
An iteration method for reliability evaluation of a fleet system
1992,
The fleet system considered here consists of n identical units (members) which are...
A Markovian model of consumer buying behavior and optimal advertising pulsing policy
A Markovian model of consumer buying behavior and optimal advertising pulsing policy
1993,
This paper deals with the problem of scheduling optimal advertising policy for a very...
A finite state Markov model with continuous time parameter for physical and chemical cutting processes
A finite state Markov model with continuous time parameter for physical and chemical cutting processes
1991,
Several processes in physics and chemistry are one-dimensional cutting processes....
A state aggregation approach to manufacturing systems having machine states with weak and strong interactions
A state aggregation approach to manufacturing systems having machine states with weak and strong interactions
1991,
A hierarchical approach to control a manufacturing system, subject to multiple machine...
Optimal stationary policies in general state space Markov decision chains with finite action sets
Optimal stationary policies in general state space Markov decision chains with finite action sets
1992,
The result of Sennott on the existence of optimal stationary policies in countable...
Truncation of Markov chains with applications to queueing
Truncation of Markov chains with applications to queueing
1991,
State-space truncation is frequently demanded for computation of large or infinite...
Stability of adaptive multistage queues
Stability of adaptive multistage queues
1991,
This paper considers the queue that arises when customers arriving at a Poisson stream...
The transition and autocorrelation structure of TES processes
The transition and autocorrelation structure of TES processes
1992,
TES (Transform-Expand-Sample) is a versatile class of stochastic sequences which can...
Chance-constrained linear programming with location scale distributions
Chance-constrained linear programming with location scale distributions
1992,
M. Kress, in 1984, studied the chance-constrained critical path problem and proved...
Some effects of nonstationarity on multiserver Markovian queueing systems
Some effects of nonstationarity on multiserver Markovian queueing systems
1991,
The authors examine the effects of nonstationarity on the performance of multiserver...
Aggregate approximation for tandem queueing systems with production blocking
Aggregate approximation for tandem queueing systems with production blocking
1991,
In this paper, the authors study problems arising in applications of the cross...
Computation reduction for a large scale Markov process model to analyse multistage production systems
Computation reduction for a large scale Markov process model to analyse multistage production systems
1992,
In order to solve a large-scale Markov decision process which optimizes the control...
Comparing trigger and kanban control of flow-line manufacture
Comparing trigger and kanban control of flow-line manufacture
1992,
The implementation of ‘kanban’ inventory control systems, originally...
A method for determining an optimal auto-save time for a word processor
A method for determining an optimal auto-save time for a word processor
1991,
The present study proposes a method for determining an optimal auto-save time for a...
An optimal N-job backup policy maximizing availability for a hard computer disk
An optimal N-job backup policy maximizing availability for a hard computer disk
1991,
Personal computers and engineering work stations are generally used with hard computer...
Optimal scheduling of inspections: A delayed Markov model with false positives and negatives
Optimal scheduling of inspections: A delayed Markov model with false positives and negatives
1991,
A system subject to catastrophic failure deteriorates according to a delayed Markov...
Large-step Markov chains for the TSP incorporating local search heuristics
Large-step Markov chains for the TSP incorporating local search heuristics
1992,
The authors consider a new class of optimization heuristics which combine local...
The finite capacity multi-server queue with inhomogeneous arrival rate and discrete service time distribution-and its application to continuous service time problems
The finite capacity multi-server queue with inhomogeneous arrival rate and discrete service time distribution-and its application to continuous service time problems
1991,
The finite capacity multi-server queueing model with inhomogeneous arrival rate and...
An approximation method for the problem of a repairable-item inventory system with lateral resupply
An approximation method for the problem of a repairable-item inventory system with lateral resupply
1992,
This paper deals with a two-echelon repairable-item inventory system which consists of...
Papers per page: