Article ID: | iaor20107388 |
Volume: | 58 |
Issue: | 5 |
Start Page Number: | 1440 |
End Page Number: | 1449 |
Publication Date: | Sep 2010 |
Journal: | Operations Research |
Authors: | Hora Stephen C |
Keywords: | aggregation |
It is shown how infinite sequences of densities with defined properties can be used to evaluate the expected performance of mathematical aggregation rules for elicited densities. The performance of these rules is measured through the average variance, calibration, and average Brier score of the aggregates. A general result for the calibration of the arithmetic average of densities from well-calibrated independent experts is given. Arithmetic and geometric aggregation rules are compared using sequences of normal densities. Sequences are developed that exhibit dependence among experts and lack of calibration. The impact of correlation, number of experts, and degree of calibration on the performance of the aggregation is demonstrated.