Evaluation of embedded intelligent real-time systems

Over the past two decades, questions have surfaced about the effectiveness and contribution of intelligent systems to decision makers in a variety of settings. This paper focuses on the evaluation challenges associated with intelligent real-time software sytems that are embedded in larger host systems. With the proliferation of such systems in operational settings such as aerospace, medical, manufacturing, and transportation systems, increased attention to evaluations of such systems, and to resulting software safety, is warranted. This paper describes one such evaluation and proposes a set of evaluation criteria for embedded intelligent real-time systems. Implications of the evaluation and the evaluation criteria are discussed.