Psychometric validity of the Shirom-Melamed Burnout Measure and the Burnout Assessment Tool: a systematic review

Arh Hig Rada Toksikol. 2023 Dec 29;74(4):238-245. doi: 10.2478/aiht-2023-74-3769. eCollection 2022.

Abstract

In the absence of internationally recognised standardised criteria, several patient-reported outcome measures (PROMs) have been developed to measure occupational burnout. The aim of this study was to extend our 2021 review of the psychometric validity of five PROMs to the Shirom-Melamed Burnout Measure (SMBM) and the Burnout Assessment Tool (BAT). To do that we ran a systematic literature search in the MEDLINE, PsycINFO, and Embase databases following our previous methodological framework and the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN). We assessed the level of evidence using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) guideline. We identified 694 publications on SMBM and 421 on BAT, but the final review includes eight papers on SMBM and three on BAT. Of the seven psychometric properties assessed for SMBM, content, structural, and criterion validity were rated as insufficient, whereas the quality of evidence for construct and internal consistency was high and moderate, respectively. Of the nine psychometric properties assessed for BAT, content, structural, criterion, and construct validity was moderate and internal consistency was high. One limitation of this study is that we did not assess cross-cultural validity, because the number of studies reviewed is too small and content validity can only be assessed based on the original PROM version rather than translation. To conclude, BAT is superior to SMBM in terms of psychometric validity, but the quality of evidence for some properties is low or very low, suggesting a need for additional validation studies.

U nedostatku međunarodno priznatih standardiziranih kriterija osmišljeno je nekoliko mjera ishoda koje opisuje pacijent (engl. patient-reported outcome measures, krat. PROM) za mjerenje profesionalnog izgaranja. Cilj je ovog ispitivanja bio proširiti naš prethodni pregled psihometrijske valjanosti pet PROM-ova iz 2021. na upitnike Shirom-Melamed Burnout Measure (SMBM) i Burnout Assessment Tool (BAT). U tu smo svrhu sustavno pretražili literaturu dostupnu u bazama podataka MEDLINE, PsycINFO i Embase, služeći se metodološkim okvirom iz prethodnog ispitivanja te tzv. COSMIN standardima za odabir mjernih instrumenata temeljenima na konsenzusu (izv. COnsensus-based Standards for the selection of health Measurement Instruments). Razinu dokaza ocjenjivali smo pomoću smjernica Grading of Recommendations, Assessment, Development, and Evaluation (GRADE). Pretragom su izdvojene 694 publikacije za SMBM te 421 za BAT, no ovaj konačni pregled obuhvaća osam članaka o SMBM-u i tri o BAT-u. Od sedam ocijenjenih psihometrijskih svojstava za SMBM, valjanost sadržaja i strukture kriterija ocijenjeni su nedovoljnom ocjenom, a kakvoća dokaza za konstrukt odnosno interna konzistencija ocijenjeni su kao snažni odnosno umjereni. Od devet psihometrijskih svojstava za BAT, valjanost sadržaja te strukture kriterija i konstrukta ocijenjeni su umjerenima, a interna konzistencija snažnom. Jedno od ograničenja ovoga ispitivanja svakako je činjenica da nismo ocjenjivali međukulturnu valjanost (engl. cross-cultural validity) budući da je količina pregledanih ispitivanja premalena, a valjanost sadržaja može se ocijeniti isključivo na temelju izvorne inačica PROM-a, a ne njezina prijevoda. Zaključno, BAT ima bolju psihometrijsku valjanost od SMBM-a, no kakvoća je dokaza za pojedina svojstva niska ili veoma niska, što upućuje na daljnja istraživanja valjanosti.

Keywords: BAT; SMBM; mjere ishoda koje opisuje pacijent; occupational burnout; patient-reported outcome measures; profesionalno izgaranje; psihometrijska svojstva; psychometric properties.

Publication types

  • Systematic Review

MeSH terms

  • Burnout, Professional*
  • Burnout, Psychological
  • Humans
  • Psychometrics
  • Surveys and Questionnaires