Second derivative estimation using harmonic analysis

Simulation sensitivity analysis is an important problem for simulation practitioners analyzing complex systems. The significance of this problem has resulted in the development of various gradient estimators that can be used to address this issue. Although higher derivative estimators have been discussed concurrently, less attention has been given to assess the efficiency and feasibility of computing such estimators. In this paper, two second derivative estimators are presented. The first estimators, called the HFD estimators, combine harmonic gradient estimators with finite differences second derivative estimators. The resulting hybrid estimators require O(p) fewer simulation runs to implement compared to the straightforward finite differences approach, where p is the number of input parameters in the simulation model. The second estimators, called the HA estimators, incorporate harmonic analysis directly, requiring one or two simulation runs to implement, depending on whether a control variate simulation run is made. Expressions for the bias and the variance of the HFD and the HA estimators (with and without variance reduction techniques) are derived. Optimal mean squared error convergence rates are also discussed. In particular, the convergence rates for both these estimators are shown to be the same, though the computational performance of the HFD estimators is better than that for the HA estimators on an M/M/1 queue simulation model. Computational results for the HFD estimators on an (s,S) inventory system simulation model are also included.