Article ID: | iaor200971927 |
Country: | Germany |
Volume: | 70 |
Issue: | 2 |
Start Page Number: | 285 |
End Page Number: | 312 |
Publication Date: | Oct 2009 |
Journal: | Mathematical Methods of Operations Research |
Authors: | Piunovskiy A B |
Fluid models are used to study functionals of the underlying random processes. Instead of analysing the trajectories, we investigate algebraic equations of the dynamic programming type which turn out to be discrete analogs of the corresponding differential equations. This analysis makes it possible to estimate the accuracy of approximation. Since the algebraic equations are the same for random walks and continuous time birth-and-death processes, we study the two cases in parallel. Several illustrative examples are also presented.