Effectiveness of EMT deployments have long been questioned. It is often suspected that EMTs are reluctant to share information that could be used for evaluation because they are concerned by the gap between expected and reality. The multitude of methods used to evaluate, without similar language, limits comparisons, and makes it difficult to make any meaningful generalizations on conclusions and recommendations. Hence, a common set of criteria to evaluate an EMT deployment must be established.

To understand perspectives of evaluating EMT deployments for floods, tropical cyclones, earthquakes, and tsunamis

In-depth interviews were conducted with 17 EMT stakeholders. Mentioned evaluation indicators were listed in the Delphi Method questionnaire.

Two rounds of Delphi Method questionnaire were conducted, where fifteen and sixteen participants responded respectively, with all participants in round one responding to round two. Participants were asked to rate evaluation indicators and respective questions according to their perceived suitability using a four-point Likert scale. Suggestions provided in the first round were incorporated into the second round. Consensus was reached when more than 75% of respondents rated slightly suitable or highly suitable.

A total of 23 indicators and 160 questions have been raised, and all indicators and 157 questions reached consensus after two rounds of Delphi Method. A draft evaluation framework was formed, based on the After-Action Review published by the WHO.

A standardized evaluation framework will be beneficial to assess deployments. Further research can be done to identify areas within the evaluation framework that should be prioritized.