Keyword: markov processes

Found 1372 papers in total
A sequential stochastic passenger screening problem for aviation security
A sequential stochastic passenger screening problem for aviation security
2009,
Designing effective aviation security systems has become a problem of national...
A patient stochastic model to support human resource planning in home care
A patient stochastic model to support human resource planning in home care
2010,
A large number of variables and unpredictable events affect the quality of home care...
Terror queues
Terror queues
2010,
This article presents the first models developed specifically for understanding the...
On a Markov game with one-sided information
On a Markov game with one-sided information
2010,
We apply the average cost optimality equation to zero-sum Markov games by considering...
Steady state analysis of a non-Markovian bulk queueing system with overloading and multiple vacations
Steady state analysis of a non-Markovian bulk queueing system with overloading and multiple vacations
2010,
This paper analyses a non-Markovian bulk queueing model with the possibility of...
Error bounds for approximations from projected linear equations
Error bounds for approximations from projected linear equations
2010,
We consider linear fixed point equations and their approximations by projection on a...
Admission control for a multi-server queue with abandonment
Admission control for a multi-server queue with abandonment
2010,
In a M / M / N + M queue, when there are many customers waiting, it may be preferable...
Dynamic coordination of production planning and sales admission control in the presence of a spot market
Dynamic coordination of production planning and sales admission control in the presence of a spot market
2010,
We consider the decision‐making problem of dynamically scheduling the...
On evaluating information revelation policies in procurement auctions: A Markov decision process approach
On evaluating information revelation policies in procurement auctions: A Markov decision process approach
2010,
Each market session in a reverse electronic marketplace features a procurer and many...
Structured replacement policies for a Markov-modulated shock model
Structured replacement policies for a Markov-modulated shock model
2009,
We establish the optimality of structured replacement policies for a periodically...
Reliability evaluation of linear consecutive-weighted-k-out-of-n:F system
Reliability evaluation of linear consecutive-weighted-k-out-of-n:F system
2009,
Reliability evaluation has a vital importance at all stages of processing and...
Semi-Markov reliability models with recurrence times and credit rating applications
Semi-Markov reliability models with recurrence times and credit rating applications
2009,
We show how it is possible to construct efficient duration dependent...
Markov decision process approach for multiple objective hazardous material transportation route selection problem
Markov decision process approach for multiple objective hazardous material transportation route selection problem
2010,
We consider a route selection problem for hazardous materials (hazmats)...
Life cycle inventory policy characterizations for a single-product recoverable system
Life cycle inventory policy characterizations for a single-product recoverable system
2010,
This paper investigates the optimal inventory policies over the life cycle of a...
Optimal inventory policies under stochastic production and demand rates
Optimal inventory policies under stochastic production and demand rates
2008,
We consider a single stage production-inventory system whose production and demand...
Solutions of the average cost optimality equation for finite Markov decision chains: risk-sensitive and risk-neutral criteria
Solutions of the average cost optimality equation for finite Markov decision chains: risk-sensitive and risk-neutral criteria
2009,
This work is concerned with controlled Markov chains with finite state and action...
Determining the maximum periodic inspection interval for medium voltage motors using a Markov model
Determining the maximum periodic inspection interval for medium voltage motors using a Markov model
2008,
Maintenance issues have been receiving ever greater attention in the industrial...
Real time study of a k-out-of-n system: n identical elements with increasing failure rates
Real time study of a k-out-of-n system: n identical elements with increasing failure rates
2009,
Reliability models based on Markov chain (Except in queueing systems) have extensive...
A semi-Markov decision algorithm for the optimal maintenance of a multistage deteriorating two-unit standby system
A semi-Markov decision algorithm for the optimal maintenance of a multistage deteriorating two-unit standby system
2009,
The semi-Markov decision model is a powerful tool in analyzing sequential decision...
Are National Hockey League referees Markov?
Are National Hockey League referees Markov?
2009,
The media and hockey fans have generally criticized National Hockey League (NHL)...
Optimal search for a moving target with the option to wait
Optimal search for a moving target with the option to wait
2009,
We investigate the problem in which an agent has to find an object that moves between...
On a Markov-modulated shock and wear process
On a Markov-modulated shock and wear process
2009,
We present transient and asymptotic reliability indices for a single-unit system that...
Availability of deteriorating system under inspection and maintenance strategies
Availability of deteriorating system under inspection and maintenance strategies
2009,
In this paper, a Markov model is used to derive the steady state availability of a...
Discrete Euler processes and their applications
Discrete Euler processes and their applications
2009,
This paper introduces discrete Euler processes and shows their application in...
Papers per page: