Background: Improving response capacities in the EU requires a good overview of capacities at both country and Union level. The International Health Regulations (2005) Monitoring and Evaluation framework assesses capacities in countries. It includes semi-quantitative tools such as State Parties Annual Report (SPAR) and Joint External Evaluation (JEE). After Action Reviews (AAR) and Simulation Exercises (SimEx) were included to identify weaknesses in the functionality of capacities which are not addressed bySPAR and JEE. This study presents an analysis of the use of qualitative tools at regional level, in Europe. It aims to identify their added value by comparing them to standardised monitoring tools and lessons learned from COVID-19, and considers ways to improve their use in assessing capacities in the EU.
Methods: We included 17 SimEx and 2 AAR organised by the European Commission between 2005 and 2018. We categorised a total of 357 recommendations according to the IHR (2005) core capacities and to the target audience of the recommendation. We analysed the data using language analysis software. Recommendations to countries were compared to SPAR and JEE indicators. Recommendations to EU agencies were compared to the current mandates of the EU agencies, and to lessons learnt during COVID-19.
Results: Of all extracted recommendations from the exercises, 59% (211/357) targeted EU agencies, 18% (64/357) targeted countries, and 16% (57/357) targeted both. Recommendations mainly addressed areas of IHR coordination (C2), heath emergency management (C7) and risk communication (C10), and not low scoring areas. Recommendations complement SPAR indicators by identifying gaps in functionality. Eight out of ten early lessons learnt during the COVID-19 pandemic had been raised earlier as recommendations from exercises. Exercise reports did not include or result in action plans for implementation, but COVID-19 has accelerated implementation of some recommendations.
Conclusion: SimEx/AAR provide valuable insight into public health preparedness at EU level, as they assess functionality of preparedness and response mechanisms, point out gaps, and provide training and awareness on for participants, who often have key roles in public health emergencies. Better follow-up and implementation of recommendations is key to improve the regional preparedness for international public health incidents such as pandemics.
Keywords: After action review; European Union; IHR; Monitoring and evaluation; Public health preparedness; Simulation exercises.
© 2023. The Author(s).