On the quality of the data envelopment analysis model

The user of data envelopment analysis has little available guidance on model quality. The technique offers none of the misspecification tests or goodness of fit statistics developed for parametric statistical methods. Yet, if a DEA model is to guide managerial policy, the quality of the model is of crucial importance. This paper suggests four alternative purposes of DEA modelling, and offers four measures of the quality of a DEA model which reflect those purposes. Using Monte Carlo simulation methods, it explores the performance of DEA under a wide variety of assumptions. It notes that four issues will have an important influence on model results: the distribution of true efficiencies in the study sample; the size of the sample; the number of inputs and outputs included in the analysis; and the degree of correlation between inputs and outputs. The paper concludes that any judgement about the reliability of model results must be dependent on the objective of the analysis.