An Analytic Method for Evaluating the Performance of Aggregation Rules for Probability Densities

An Analytic Method for Evaluating the Performance of Aggregation Rules for Probability Densities

0.00 Avg rating0 Votes
Article ID: iaor20107388
Volume: 58
Issue: 5
Start Page Number: 1440
End Page Number: 1449
Publication Date: Sep 2010
Journal: Operations Research
Authors:
Keywords: aggregation
Abstract:

It is shown how infinite sequences of densities with defined properties can be used to evaluate the expected performance of mathematical aggregation rules for elicited densities. The performance of these rules is measured through the average variance, calibration, and average Brier score of the aggregates. A general result for the calibration of the arithmetic average of densities from well-calibrated independent experts is given. Arithmetic and geometric aggregation rules are compared using sequences of normal densities. Sequences are developed that exhibit dependence among experts and lack of calibration. The impact of correlation, number of experts, and degree of calibration on the performance of the aggregation is demonstrated.

Reviews

Required fields are marked *. Your email address will not be published.