Consider a series system consisting of n components of k types. Whenever a unit fails, it is replaced immediately by a new one to keep the system working. Under the assumption that all the life lengths of the components is independent and exponentially distributed and that the replacement policies depend only on the present state of the system at each failure, the system may be represented by a birth and death process. The existence of the optimum replacement policies are discussed and the ϵ-optimal policies are derived. If the past experience of the system can also be utilized, the process is not a Markov process. The optimum Bayesian policies are derived and the properties of the resulting process are studied. Also, the stochastic processes are simulated and the probability of absorption, the mean time to absorption and the average proportion of the retrograde motion are approximated.