Classifying and Mapping Cultural Ecosystem Services Using Artificial Intelligence and Social Media Data

Wetlands (Wilmington). 2022;42(7):86. doi: 10.1007/s13157-022-01616-9. Epub 2022 Oct 8.

Abstract

Quantifying and mapping cultural ecosystem services are complex because of their intangibility. Data from social media, such as geo-tagged photographs, has been proposed for mapping cultural use or appreciation of ecosystems. However, manual content analysis and classification of large numbers of photographs is time-consuming. The potential of deep learning for automating the analysis of crowdsourced social media content is still being explored in CES research. Here, we use a new deep learning model for automating the classification of natural and human elements relevant to CES from Flickr images. This approach applies a convolutional neural network architecture to analyze over 29,000 photographs from the Lithuanian coast and uses hierarchical clustering to group these photographs. The accuracy of the classification was assessed by comparison with manual classification. Over 37% of the photographs were taken for the landscape appreciation class, and 28% of the photographs were taken of nature, of animals or plants, which represent the nature appreciation class. The main clusters were identified in urban areas, more precisely in the main coastal cities of Lithuania. The distribution of the nature photographs was concentrated around particular natural attractions, and they were more likely to occur in parks and natural reserves with high levels of vegetation and animal cover. This approach that was developed for clustering the photographs was accurate and saved approximately 100 km of manual work. The method demonstrates how analyzing large numbers of digital photographs expands the analytical toolbox available to researchers and allows the quantification and mapping of CES at large geographical scales. Automated assessment and mapping of cultural ecosystem services could be used to inform urban planning and improve nature reserve management.

Keywords: Convolutional neural networks; Crowdsourced data; Cultural ecosystem services mapping; Flicker data; Images classification; Lithuanian coast; Machine learning.