Background: During the COVID-19 pandemic, wastewater-based surveillance gained great international interest as an additional tool to monitor SARS-CoV-2. In autumn 2021, the Norwegian Institute of Public Health decided to pilot a national wastewater surveillance (WWS) system for SARS-CoV-2 and its variants between June 2022 and March 2023. We evaluated the system to assess if it met its objectives and its attribute-based performance.
Methods: We adapted the available guidelines for evaluation of surveillance systems. The evaluation was carried out as a descriptive analysis and consisted of the following three steps: (i) description of the WWS system, (ii) identification of users and stakeholders, and (iii) analysis of the system's attributes and performance including sensitivity, specificity, timeliness, usefulness, representativeness, simplicity, flexibility, stability, and communication. Cross-correlation analysis was performed to assess the system's ability to provide early warning signal of new wave of infections.
Results: The pilot WWS system was a national surveillance system using existing wastewater infrastructures from the largest Norwegian municipalities. We found that the system was sensitive, timely, useful, representative, simple, flexible, acceptable, and stable to follow the general trend of infection. Preliminary results indicate that the system could provide an early signal of changes in variant distribution. However, challenges may arise with: (i) specificity due to temporary fluctuations of RNA levels in wastewater, (ii) representativeness when downscaling, and (iii) flexibility and acceptability when upscaling the system due to limited resources and/or capacity.
Conclusions: Our results showed that the pilot WWS system met most of its surveillance objectives. The system was able to provide an early warning signal of 1-2 weeks, and the system was useful to monitor infections at population level and complement routine surveillance when individual testing activity was low. However, temporary fluctuations of WWS values need to be carefully interpreted. To improve quality and efficiency, we recommend to standardise and validate methods for assessing trends of new waves of infection and variants, evaluate the WWS system using a longer operational period particularly for new variants, and conduct prevalence studies in the population to calibrate the system and improve data interpretation.
Keywords: COVID-19; Norway; SARS-CoV-2; Surveillance evaluation; Wastewater.
© 2023. BioMed Central Ltd., part of Springer Nature.