Spatiotemporal informer: A new approach based on spatiotemporal embedding and attention for air quality forecasting

Environ Pollut. 2023 Nov 1:336:122402. doi: 10.1016/j.envpol.2023.122402. Epub 2023 Aug 17.

Abstract

Accurate prediction of air pollution is essential for public health protection. Air quality, however, is difficult to predict due to the complex dynamics, and its accurate forecast still remains a challenge. This study suggests a spatiotemporal Informer model, which uses a new spatiotemporal embedding and spatiotemporal attention, to improve AQI forecast accuracy. In the first phase of the proposed forecast mechanism, the input data is transformed by the spatiotemporal embedding. Next, the spatiotemporal attention is applied to extract spatiotemporal features from the embedded data. The final forecast is obtained based on the attention tensors. In the proposed forecast model, the input is a 3-dimensional data that consists of air quality data (AQI, PM2.5, O3, SO2, NO2, CO) and geographic information, and the output is a multi-positional, multi-temporal data that shows the AQI forecast result of all the monitoring stations in the study area. The proposed forecast model was evaluated by air quality data of 34 monitoring stations in Beijing, China. Experiments showed that the proposed forecast model could provide highly accurate AQI forecast: the average of MAPE values for from 1 h to 20 h ahead forecast was 11.61%, and it was much smaller than other models. Moreover, the proposed model provided a highly accurate and stable forecast even at the extreme points. These results demonstrated that the proposed spatiotemporal embedding and attention techniques could sufficiently capture the spatiotemporal correlation characteristics of air quality data, and that the proposed spatiotemporal Informer could be successfully applied for air quality forecasting.

Keywords: Air quality; Deep learning; Informer; Spatiotemporal attention; Spatiotemporal embedding.