Design and Evaluation of a Contextual Model for Information Retrieval From Web-Scale Discovery Services to Improve Evidence-Based Practice by Health Care Practitioners: Mixed Methods Study

Abstract

Background: Practicing evidence-based health care is challenging because of overwhelming results presented to practitioners by Google-like Web-scale discovery (WSD) services that index millions of resources while retrieving information based on relevancy algorithms with limited consideration for user information need.

Objective: On the basis of the user-oriented theory of information need and following design science principles, this study aimed to develop and evaluate an innovative contextual model for information retrieval from WSD services to improve evidence-based practice (EBP) by health care practitioners.

Methods: We identified problems from literature to support real-world requirements for this study. We used design science research methodology to guide artefact design. We iteratively improved prototype of the context model using artificial formative evaluation. We performed naturalistic summative evaluation using convergent interviewing of health care practitioners and content analysis from a confirmatory focus group consisting of health researchers to evaluate the model's validity and utility.

Results: The study iteratively designed and applied the context model to a WSD service to meet 5 identified requirements. All 5 health care practitioners interviewed found the artefact satisfied the 5 requirements to successfully evaluate the model as having validity and utility. Content analysis results from the confirmatory focus group mapped top 5 descriptors per requirement to support a true hypothesis that there is significant discussion among participants to justify concluding that the artefact had validity and utility.

Conclusions: The context model for WSD satisfied all requirements and was evaluated successfully for information retrieval to improve EBP. Outcomes from this study justify further research into the model.

Keywords: Web-scale discovery; artefacts; design science research; evidence-based practice; information retrieval; libraries, digital.