An empirical comparison of utility assessment programs

This paper reports on an experimental investigation of the utility functions elicted by four different utility elicitation computer programs. We were able to confirm that decision-making subjects will to a degree follow the recommendation of a utility elicitation program in contravention to the subject's intuitive judgments of preference. Further, we found systematic differences in this regard among the four programs. Programs that confront subjects with their inconsistencies and force a reworking of the subjects' expressed preferences appear to produce utility functions with greater acceptance by decision makers. Similarly, programs that employ a direct manipulation style of interface also appear to result in greater acceptance by subjects of the utility functions elicited.