A framework for evaluating systems thinking interventions: An experimental approach to mental health system change

Researchers from the State University of New York at Albany and the New York State Office of Mental Health have been engaged in testing an experimental approach to evaluating systems thinking interventions. This research calls for a similar systems thinking intervention to be repeated in four counties with four control counties also selected and observed via pre- and post-intervention measures. The overall context of the project focuses on integration of mental health and vocational rehabilitation services. The experiment is designed to evaluate measurable outcomes, including shifts in goal structures and change strategies of the management team, shifts in relative alignment of the management team as a whole, perceived success of the intervention, and changes in systems and procedures necessary to improve client services. This article presents a framework for evaluating systems thinking interventions as well as preliminary findings from the pilot test.