A machine learning method for multi-expert decision support

When a decision maker has access to multiple expert systems, each embodying a different expert perspective on analyzing and reasoning about the same kind of decision problem, an important consideration is which to use at what times. We address this issue with a method based on competition among the distinct expert systems (and their respective rules). We begin by reviewing prior research concerned with the coordination of multiple sources of expertise in support of decision making, pointing out potential weaknesses of the proposed methods. Next, we introduce a new coordination method based on the competitive paradigm that has been applied in machine learning. This method involves adjustments to the strengths of expert systems and to their constituent rules based on their performances. A nine-step process for adjusting strengths is described. Advantages and limitations of this new method for expert system coordination are discussed. We outline an approach to testing the coordination method and report on preliminary testing of the performance of a system employing our method versus the performance of individual experts.