Keyword: markov processes

Found 1372 papers in total
Performance evaluation of SVC-based IP-over-ATM networks
Performance evaluation of SVC-based IP-over-ATM networks
1998,
We propose a finite-capacity single-vacation model, with close-down/setup times and a...
Control of a single-server tandem queueing system with setups
Control of a single-server tandem queueing system with setups
1998,
This paper considers the control of a single-server tandem queueing system with...
Lagrangian heuristics for the two-echelon, single-source, capacitated facility location problem
Lagrangian heuristics for the two-echelon, single-source, capacitated facility location problem
1997,
Facility location problems form an important class of integer programming problems,...
A state space condition monitoring model for furnace erosion prediction and replacement
A state space condition monitoring model for furnace erosion prediction and replacement
1997,
The paper develops a replacement action decision aid for a key furnace component...
Correlation of interdeparture times in M/G/1 and M/G/1/K queues
Correlation of interdeparture times in M/G/1 and M/G/1/K queues
1998,
Correlation of consecutive interdeparture times characterizes the output process in a...
Monitoring machine operations using on-line sensors
Monitoring machine operations using on-line sensors
1997,
Monitoring machine operations and production process conditions using on-line sensors...
Coordinated condition-based repair strategies for components of a multi-component maintenance system with discounts
Coordinated condition-based repair strategies for components of a multi-component maintenance system with discounts
1997,
This paper presents a heuristic algorithm for computing upper and lower control limit...
Optimal replacement policies with minimal repair and age-dependent costs
Optimal replacement policies with minimal repair and age-dependent costs
1997,
In this paper, we study a modified minimal repair/replacement problem that is...
Cost models in nonhomogeneous Markov systems
Cost models in nonhomogeneous Markov systems
1997,
We study the problem of introducing the phases through which a nonhomogeneous Markov...
Can difficult-to-reuse syringes reduce the spread of HIV among injection drug users?
Can difficult-to-reuse syringes reduce the spread of HIV among injection drug users?
1998,
Sharing of syringes by injection drug users is a principal means by which the human...
Stochastic modelling of combat with reinforcement
Stochastic modelling of combat with reinforcement
1997,
The homogeneous combat when reinforcements are made at prespecified force levels has...
A scale-down solution of N2–1 puzzle
A scale-down solution of N2–1 puzzle
1998,
Real-time decision making algorithms like ‘real-time search’ have become...
Predicting the long-run profit impact of a contemplated sales force compensation plan
Predicting the long-run profit impact of a contemplated sales force compensation plan
1997,
Analytical sales force compensation research offers only limited answers to sales...
Lumpability in LRU stack with Markovian page references
Lumpability in LRU stack with Markovian page references
1998,
The dynamic behavior of programs is studied through LRU (Least-Recently-Used) stack...
DT-planner: An environment for managing dynamic decision problems
DT-planner: An environment for managing dynamic decision problems
1997,
The problem of formulating plans under uncertainty and coping with dynamic decision...
Asynchronous stochastic-approximation and Q-learning
Asynchronous stochastic-approximation and Q-learning
1994,
We provide some general results on the convergence of a class of stochastic...
Using randomization to break the curse of dimensionality
Using randomization to break the curse of dimensionality
1997,
This paper introduces random versions of successive approximations and multigrid...
Markov-type fuzzy decision processes with a discounted reward on a closed interval
Markov-type fuzzy decision processes with a discounted reward on a closed interval
1996,
We formulate a new multi-stage decision process with Markov-type fuzzy transition,...
Hoare's selection algorithm: A Markov chain approach
Hoare's selection algorithm: A Markov chain approach
1998,
We obtain bounds for the distribution of the number of comparisons needed by Hoare's...
Approximations of general discrete time queues by discrete time queues with arrivals modulated by finite chains
Approximations of general discrete time queues by discrete time queues with arrivals modulated by finite chains
1997,
Recently, Asmussen and Koole showed that any discrete or continuous time marked point...
Convergence rate for the distributions of GI/M/1/n and M/GI/1/n as n tends to infinity
Convergence rate for the distributions of GI/M/1/n and M/GI/1/n as n tends to infinity
1997,
In this note, we compare the arrival and time stationary distributions of the number...
Bias optimality in controlled queueing systems
Bias optimality in controlled queueing systems
1998,
This paper studies an admission control M/M/ 1 queueing system. It shows that the only...
On the GIXn/G/∞ system with Markov dependent batch arrivals
On the GIXn/G/∞ system with Markov dependent batch arrivals
1998,
We consider an infinite server system with Markov dependent batch sizes for arrivals....
Phase transition and law of large numbers for a non-symmetric one-dimensional random walk with self-interactions
Phase transition and law of large numbers for a non-symmetric one-dimensional random walk with self-interactions
1998,
We study a not necessarily symmetric random walk with interactions on ℤ, which is...
Papers per page: