Article ID: | iaor20117347 |
Volume: | 214 |
Issue: | 3 |
Start Page Number: | 732 |
End Page Number: | 738 |
Publication Date: | Nov 2011 |
Journal: | European Journal of Operational Research |
Authors: | Buckinx Wouter, Coussement Kristof |
Keywords: | probability |
Calibration refers to the adjustment of the posterior probabilities output by a classification algorithm towards the true prior probability distribution of the target classes. This adjustment is necessary to account for the difference in prior distributions between the training set and the test set. This article proposes a new calibration method, called the probability‐mapping approach. Two types of mapping are proposed: linear and non‐linear probability mapping. These new calibration techniques are applied to 9 real‐life direct marketing datasets. The newly‐proposed techniques are compared with the original, non‐calibrated posterior probabilities and the adjusted posterior probabilities obtained using the rescaling algorithm of . The results recommend that marketing researchers must calibrate the posterior probabilities obtained from the classifier. Moreover, it is shown that using a ‘simple’ rescaling algorithm is not a first and workable solution, because the results suggest applying the newly‐proposed non‐linear probability‐mapping approach for best calibration performance.