How do interactive flood simulation models influence decision-making? An observations-based evaluation method

Interactive flood simulations models are computer models that are usable for practitioners during work sessions, allowing demand-driven flood simulations together with domain experts. It is assumed among developers of such models that these interactive models better serve decisionmaking processes, resulting in better informed decisions about, for example, evacuation and rescue operations. In order to test this assumption, we present a method that uses observations to monitor and evaluate decision-making processes in work sessions where interactive models are applied. We present a theoretical framework as a basis for this method, based on theory of collaborative knowledge construction, and operationalize this into measurable metrics. We demonstrate our method in two cases of flood disaster management and illustrate and discuss the strengths and weaknesses.