AraCust: a Saudi Telecom Tweets corpus for sentiment analysis

Latifah Almuqren; Alexandra Cristea

doi:10.7717/peerj-cs.510

AraCust: a Saudi Telecom Tweets corpus for sentiment analysis

PeerJ Comput Sci. 2021 May 20:7:e510. doi: 10.7717/peerj-cs.510. eCollection 2021.

Authors

Latifah Almuqren^{1

2}, Alexandra Cristea¹

Affiliations

¹ Department of Computer Science, Durham University, Durham, United Kingdom.
² Information Science Department, Computer and Information Sciences College, Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Abstract

Comparing Arabic to other languages, Arabic lacks large corpora for Natural Language Processing (Assiri, Emam & Al-Dossari, 2018; Gamal et al., 2019). A number of scholars depended on translation from one language to another to construct their corpus (Rushdi-Saleh et al., 2011). This paper presents how we have constructed, cleaned, pre-processed, and annotated our 20,0000 Gold Standard Corpus (GSC) AraCust, the first Telecom GSC for Arabic Sentiment Analysis (ASA) for Dialectal Arabic (DA). AraCust contains Saudi dialect tweets, processed from a self-collected Arabic tweets dataset and has been annotated for sentiment analysis, i.e.,manually labelled (k=0.60). In addition, we have illustrated AraCust's power, by performing an exploratory data analysis, to analyse the features that were sourced from the nature of our corpus, to assist with choosing the right ASA methods for it. To evaluate our Golden Standard corpus AraCust, we have first applied a simple experiment, using a supervised classifier, to offer benchmark outcomes for forthcoming works. In addition, we have applied the same supervised classifier on a publicly available Arabic dataset created from Twitter, ASTD (Nabil, Aly & Atiya, 2015). The result shows that our dataset AraCust outperforms the ASTD result with 91% accuracy and 89% F1avg score. The AraCust corpus will be released, together with code useful for its exploration, via GitHub as a part of this submission.

Keywords: Arabic; Gold Standard Corpus; Sentiment analysis; Supervised approach.

Grants and funding

This research was funded by the Deanship of Scientific Research at Princess Nourah bint Abdulrahman University, Saudi Arabia through the Fast-track Research Funding Program. There was no additional external funding received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.