Subjective probability assessment in decision analysis: Partition dependence and bias toward the ignorance prior

Subjective probability assessment in decision analysis: Partition dependence and bias toward the ignorance prior

0.00 Avg rating0 Votes
Article ID: iaor2008544
Country: United States
Volume: 51
Issue: 9
Start Page Number: 1417
End Page Number: 1432
Publication Date: Sep 2005
Journal: Management Science
Authors: ,
Keywords: risk
Abstract:

Decision and risk analysts have considerable discretion in designing procedures for eliciting subjective probabilities. One of the most popular approaches is to specify a particular set of exclusive and exhaustive events for which the assessor provides such judgments. We show that assessed probabilities are systematically biased toward a uniform distribution over all events into which the relevant state space happens to be partitioned, so that probabilities are ‘partition dependent.’ We surmise that a typical assessor begins with an ‘ignorance prior’ distribution that assigns equal probabilities to all specified events, then adjusts those probabilities insufficiently to reflect his or her beliefs concerning how the likelihoods of the events differ. In five studies, we demonstrate partition dependence for both discrete events and continuous variables (Studies 1 and 2), show that the bias decreases with increased domain knowledge (Studies 3 and 4), and that top experts in decision analysis are susceptible to this bias (Study 5). We relate our work to previous research on the ‘pruning bias’ in fault-tree assessment and show that previous explanations of pruning bias (enhanced availability of events that are explicitly specified, ambiguity in interpreting event categories, and demand effects) cannot fully account for partition dependence. We conclude by discussing implications for decision analysis practice.

Reviews

Required fields are marked *. Your email address will not be published.