Development of New Stringency Indices for Nonpharmacological Social Distancing Policies Implemented in Korea During the COVID-19 Pandemic: Random Forest Approach

Abstract

Background: In the absence of an effective treatment method or vaccine, the outbreak of the COVID-19 pandemic elicited a wide range of unprecedented restriction policies aimed at mitigating and suppressing the spread of the SARS-CoV-2 virus. These policies and their Stringency Index (SI) of more than 160 countries were systematically recorded in the Oxford COVID-19 Government Response Tracker (OxCGRT) data set. The SI is a summary measure of the overall strictness of these policies. However, the OxCGRT SI may not fully reflect the stringency levels of the restriction policies implemented in Korea. Korea implemented 33 COVID-19 restriction policies targeting 4 areas: public facilities, public events, social gatherings, and religious gatherings.

Objective: This study aims to develop new Korea Stringency Indices (KSIs) that reflect the stringency levels of Korea's restriction policies better and to determine which government-implemented policies were most effective in managing the COVID-19 pandemic in Korea.

Methods: The random forest method was used to calculate the new KSIs using feature importance values and determine their effectiveness in managing daily COVID-19 confirmed cases. Five analysis periods were considered, including November 01, 2020, to January 20, 2021 (Period 1), January 20, 2021, to June 27, 2021 (Period 2), November 01, 2020, to June 27, 2021 (Period 3), June 27, 2021, to November 01, 2021 (Period 4), and November 01, 2021, to April 24, 2022 (Period 5).

Results: Among the KSIs, public facilities in period 4, public events in period 2, religious gatherings in periods 1 and 3, and social gatherings in period 5 had the highest importance. Among the public facilities, policies associated with operation hour restrictions in cinemas, restaurants, PC rooms, indoor sports facilities, karaoke, coffee shops, night entertainment facilities, and baths or saunas had the highest importance across all analysis periods. Strong positive correlations were observed between daily confirmed cases and public facilities, religious gatherings, and public events in period 1 of the pandemic. From then, weaker and negative correlations were observed in the remaining analysis periods. The comparison with the OxCGRT SI showed that the SI had a relatively lower feature importance and correlation with daily confirmed cases than the proposed KSIs, making KSIs more effective than SI.

Conclusions: Restriction policies targeting public facilities were the most effective among the policies analyzed. In addition, different periods call for the enforcement of different policies given their effectiveness varies during the pandemic.

Keywords: COVID-19; Korea Stringency Index; Stringency Index; effectiveness; government; pandemic; physical distancing; policy; restriction; restriction policy; social distancing.