Human Rights Texts: Converting Human Rights Primary Source Documents into Data

PLoS One. 2015 Sep 29;10(9):e0138935. doi: 10.1371/journal.pone.0138935. eCollection 2015.

Abstract

We introduce and make publicly available a large corpus of digitized primary source human rights documents which are published annually by monitoring agencies that include Amnesty International, Human Rights Watch, the Lawyers Committee for Human Rights, and the United States Department of State. In addition to the digitized text, we also make available and describe document-term matrices, which are datasets that systematically organize the word counts from each unique document by each unique term within the corpus of human rights documents. To contextualize the importance of this corpus, we describe the development of coding procedures in the human rights community and several existing categorical indicators that have been created by human coding of the human rights documents contained in the corpus. We then discuss how the new human rights corpus and the existing human rights datasets can be used with a variety of statistical analyses and machine learning algorithms to help scholars understand how human rights practices and reporting have evolved over time. We close with a discussion of our plans for dataset maintenance, updating, and availability.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Algorithms*
  • Data Collection / methods*
  • Databases, Bibliographic*
  • Documentation
  • Human Rights*
  • Humans
  • Natural Language Processing*
  • Periodicals as Topic*

Grants and funding

CJF acknowledges research funding from The McCourtney Institute for Democracy Innovation Grant, and the College of Liberal Arts, both at Pennsylvania State University. FJL acknowledges support by the National Science Foundation under IGERT Grant DGE-1144860, Big Data Social Science. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.