Article ID: | iaor20039 |
Country: | United States |
Volume: | 49 |
Issue: | 6 |
Start Page Number: | 892 |
End Page Number: | 899 |
Publication Date: | Nov 2001 |
Journal: | Operations Research |
Authors: | Righter Rhonda, Liu Zhen, Koole Ger |
Keywords: | programming: dynamic |
We consider transmission policies for multiple users sharing a single wireless link to a base station. The noise, and hence the probability of correct transmission of a packet, depends on the state of the user receiving the packet. The state for each user is independent of the states of the other users and changes according to a two-state (good/bad) Markov chain. The state of a user is observed only when it transmits. We give conditions under which the optimal policy is the myopic policy, in which a packet is transmitted to the user that is most likely to be in the better of the two states. We do this by showing that the optimal value function is marginally linear in each of the users’ probabilities of being in the good state. Our model also may be applied to flexible manufacturing systems with unreliable tools and networked computer systems.