Conducting a prospective evaluation of the development of a complex psycho-oncological care programme (isPO) in Germany

BMC Health Serv Res. 2022 Apr 22;22(1):531. doi: 10.1186/s12913-022-07951-1.

Abstract

Background: Evaluating the development phase of a complex intervention programme can be challenging. A prospective evaluation approach is presented based on the example of the new complex psycho-oncological care programme isPO (integrated, cross-sectoral Psycho-Oncology). Prior to programme implementation, we examined (1) if isPO was developed as intended, and (2) if it was relevant and transferable into the newly developed psycho-oncological care networks in North-Rhine Westphalia, Germany. Further, we investigated which implementation facilitators and barriers were anticipated and which implementation strategies were planned by the programme designers (multidisciplinary professionals and cancer supporting organizations who developed the isPO programme components and the networks).

Methods: A mixed-methods approach was applied. Qualitative data were collected by quarterly progress reports, interviews and a focus group with the programme designers. Evaluation criteria for document analyses of the quarterly progress reports were developed and applied. Content analysis was applied for analysing interviews and focus group. Quantitative data were gained from evaluating the programme training for the isPO service providers by short written questionnaires that were analysed descriptively.

Results: An implementable prototype of the isPO programme has been developed within 15 months, however no piloting was conducted. The programme's complexity proved to be challenging with regard to coordination and communication of the numerous programme designers. This was intensified by existing interdependencies between the designers. Further, there was little communication and participation between the programme designers and the prospective users (patients and service providers). Due to these challenges, only context-unspecific implementation strategies were planned.

Conclusion: The required resources for developing a new complex care programme and the need of a mature implementation strategy should be sufficiently addressed. Programmes may benefit from prospective evaluation by gaining insightful knowledge concerning the programme's maturity and anticipating implementation facilitators and barriers. A mixed-methods evaluation design was crucial for achieving profound insight into the development process.

Trial registration: The study has been registered in the German Clinical Trials Register (No. DRKS00015326 ) on 30.10.2018.

Keywords: Care programme development; Complex intervention; Mixed-methods; Prospective evaluation; Psycho-oncology.

MeSH terms

  • Communication*
  • Focus Groups
  • Germany
  • Humans
  • Psycho-Oncology*
  • Surveys and Questionnaires