Experimental evaluation of multiobjective linear programming software

The level of empirical research activity in multicriteria decision-aiding software is relatively low with respect to the rate of development of new multicriteria decision making methods. This paper presents the methodology and the results of an empirical study which was conducted for the investigation of the capability of a certain software package (the ADELAIS microcomputer software) to operate as an effective decision supportive tool for multiobjective linear programming systems. The methodological framework of the study included systematic experimentation on a three-criteria agricultural management problem. The role of the decision makers was undertaken by a population of undergraduate students who used individually the ADELAIS system in order to support their decision process. The results of the study were obtained: (1) by measuring some performance indices of ADELAIS, such as its convergence capability, the information load, its capability in assessing the DM’s preferences and the computer effort; (2) by monitoring and recording the extent to which the users took advantage of the various components of the system during the decision process; (3) by recording some specific characteristics of the system as they were evaluated by the users with the help of a questionnaire.