Measurement and sampling error in mixed-methods research for the control of Peste des Petits Ruminants in the Karamoja subregion of Northeastern Uganda: A cautionary tale

Abstract

A team of interdisciplinary researchers undertook a mixed methods, participatory epidemiology (PE) based study as part of a pilot project for localized control of Peste des petits ruminants (PPR), a small ruminant disease of high socio-economic impact. Mixed methods research combines qualitative and quantitative methods, allowing iterative comparison of results to arrive at a more comprehensive and informed outcome. In this study, the use of PE and a household survey (HHS) resulted in contradictory results. However, the mixed methods approach also facilitated the detection and the explanation of bias in the HHS, which may have gone undetected and unexplored had only one method been used. Results show that logistical constraints leading to a failure to apply key aspects of the sampling strategy led to problematic gender/ethnic composition of the HHS sample population. Additionally, while PE findings on local disease and terminology were integrated during HHS development and training, there is apparent measurement error related to enumerator bias in HHS results, possibly due to insufficient respondent understanding or a lack of analytic clarity. The extensive nature of the PE, surveillance methodologies used in the initial site assessment, and formative research for the HHS allowed for a critical analysis and interpretation of HHS results as well as reflection on the research process. The findings of this paper underscore the (1) flexibility and utility of participatory methods, (2) the importance of mixed methods research in designing health interventions, and (3) the necessity of tight integration of study design with team planning for implementation of research in environments such as Karamoja, Uganda. If all three are to be achieved not only researchers but funders must provide these space and structure beginning in the study design phase. These findings are relevant in many places, but have particular importance for international, interdisciplinary teams working from various on-and-off-site locations with traditional or indigenous knowledge systems.

Keywords: Community animal health workers; Participatory epidemiology; Pastoralism; Peste des petits ruminants; Questionnaire household survey.