IADD: An integrated Arabic dialect identification dataset

Data Brief. 2021 Dec 30:40:107777. doi: 10.1016/j.dib.2021.107777. eCollection 2022 Feb.

Abstract

Arabic language has different variants that can be roughly categorized into three main categories: Classical Arabic (CA), Modern Standard Arabic (MSA) and Dialectal Arabic (DA). There are subtle differences between MSA and CA in terms of syntax, terminology and pronunciation. However, Dialectal Arabic (DA) significantly differs from CA and MSA in that it reflects geographic location of the speaker, or at least the country of origin, if mobility factors are taken into account. This paper presents IADD, an Integrated dataset for Arabic dialect identification, that contains 135 , 804 texts representing Arabic dialects from 5 regions and 9 countries. IADD dataset is created, from the combination of subsets of five corpora, to support the task of automatic Arabic dialects detection.

Keywords: Arabic language; Dialect identification; Geographic disaggregation; Web mining.