Article ID: | iaor2005735 |
Country: | Netherlands |
Volume: | 130 |
Issue: | 1 |
Start Page Number: | 217 |
End Page Number: | 239 |
Publication Date: | Aug 2004 |
Journal: | Annals of Operations Research |
Authors: | Pape Claude Le, Chabrier Alain, Danna Emilie, Perron Laurent |
Keywords: | constraint programming, robustness |
Industrial optimization applications must be “robust” i.e., they must provide good solutions to problem instances of different size and numerical characteristics, and continue to work well when side constraints are added. This paper presents a case study that addresses this requirement and its consequences on the applicability of different optimization techniques. An extensive benchmark suite, built on real network design data, is used to test multiple algorithms for robustness against variations in problem size, numerical characteristics, and side constraints. The experimental results illustrate the performance discrepancies that have occurred and how some have been corrected. In the end, the results suggest that we shall remain very humble when assessing the adequacy of a given algorithm for a given problem, and that a new generation of public optimization benchmark suites is needed for the academic community to attack the issue of algorithm robustness as it is encountered in industrial settings.