Plug-in bandwidth selector for recursive kernel regression estimators defined by stochastic approximation method

In this paper, we propose an automatic selection of the bandwidth of the recursive kernel estimators of a regression function defined by the stochastic approximation algorithm. We showed that, using the selected bandwidth and the stepsize which minimize the mean weighted integrated squared error, the recursive estimator will be better than the non‐recursive one for small sample setting in terms of estimation error and computational costs. We corroborated these theoretical results through simulation study and a real dataset.