| Article ID: | iaor20072011 |
| Country: | United States |
| Volume: | 28 |
| Issue: | 4 |
| Start Page Number: | 801 |
| End Page Number: | 835 |
| Publication Date: | Nov 2003 |
| Journal: | Mathematics of Operations Research |
| Authors: | Shwartz Adam, Dupuis Paul, Atar Rami |
| Keywords: | queues: theory |
We consider the problem of risk-sensitive control of a stochastic network. In controlling such a network, an escape-time criterion can be useful if one wishes to regulate the occurrence of large buffers and buffer overflow. In this paper a risk-sensitive escape time criterion is formulated, which in comparison to the ordinary escape-time criteria penalizes exits that occur on short time intervals more heavily. The properties of the risk-sensitive problem are studied in the large buffer limit and related to the value of a deterministic differential game with constrained dynamics. We prove that the game has value and that the value is the (viscosity) solution of a PDE. For a simple network, the value is computed, demonstrating the applicability of the approach.