Aim: To develop and content validate a self-assessment questionnaire on motivational interviewing (MI) practice as the first stages in forming the questionnaire to be used in cross-sectional studies involving practitioners conducting the MI-based alcohol screening and brief intervention (ASBI).
Methods: A comprehensive mixed methods approach included a literature review, 3 rounds of expert panel (EP) opinions (n=10), cognitive testing (CT) with 10 MI-based ASBI practitioners, and questionnaire piloting with 31 MI-based ASBI practitioners. Based on the EP opinions in the second round, content validity indices (CVIs) and the modified kappa coefficient (k*) were calculated, focusing on the relevance and understandability of questions and comprehensiveness and meaningfulness of the response options. This analysis was performed in 2020, at the conclusion of the national "Together for a Responsible Attitude Towards Alcohol Consumption" ("Skupaj za odgovoren odnos do pitja alkohola", SOPA) project's pilot implementation.
Results: On a scale level, CVI values based on universal agreement for the entire questionnaire were high for 3/4 categories (S-CVI-UA>0.80), and CVI values based on average agreement were high across all categories (S-CVI-Ave>0.90). At the item level, CVI values (I-CVI) were never <0.50 (automatic item rejection), and the modified kappa value (k*) indicated poor validity for two items in the understandability category (k*=0.33). All problematic parts of the questionnaire were further tested and successfully modified based on the results of CT, and accepted in the third round of testing.
Conclusions: The final version of the questionnaire demonstrated appropriate content validity for use in studies among Slovenian MI-based ASBI practitioners and is now ready for further psychometric testing.
Namen: Razviti samo-ocenjevalni vprašalnik o izvajanju motivacijskega intervjuja (MI) in preveriti njegovo vsebinsko veljavnost oz. izvesti prvi dve fazi oblikovanja vprašalnika za uporabo v presečnih raziskavah med izvajalci na MI temelječega kratkega svetovanja za opuščanje tveganega in škodljivega pitja alkohola (KSTŠPA).
Metode: Izvedli smo celovit pristop mešanih metod, ki je vključeval pregled literature, tri kroge mnenj skupine strokovnjakov s področja (SS) (n = 10), kognitivno testiranje (KT) vprašalnika z 10 izvajalci in pilotno testiranje vprašalnika s 31 izvajalci na MI temelječega KSTŠPA. Na podlagi mnenj SS v drugem krogu testiranja smo izračunali indekse vsebinske veljavnosti (IVV) in modificirani koeficient kappa (k*). Osredotočili smo se na 4 vsebinske kategorije: bistvenost in razumljivost vprašanj ter smiselnost in izčrpnost možnosti odgovorov. Razumljivost vprašalnika smo dodatno preverjali s kognitivnim testiranjem. Analizo smo izvedli v letu 2020 ob zaključku izvajanja pilota nacionalnega projekta Skupaj za odgovoren odnos do pitja alkohola (SOPA).
Rezultati: Vrednosti IVV na podlagi univerzalnega strinjanja strokovnjakov za celotni vprašalnik so bile ustrezno visoke (> 0,80) v 3 od 4 kategorij, IVV na podlagi povprečnega strinjanja strokovnjakov pa je bila visoka (> 0,90) v vseh kategorijah. Vrednosti IVV na ravni postavk niso bile manjše od 0,50, kar bi pomenilo avtomatično zavrnitev postavke, vrednosti k* pa so pokazale slabo veljavnost pri dveh postavkah v kategoriji razumljivost (k* = 0,33). Vse problematizirane dele vprašalnika smo dalje kognitivno testirali in na podlagi rezultatov uspešno spremenili ter so bili nato sprejeti kot ustrezni v tretjem krogu testiranja.
Zaključki: Končna različica vprašalnika ima ustrezno vsebinsko veljavnost za uporabo med slovenskimi izvajalci na MI temelječega KSTŠPA in je pripravljena na preverjanje psihometričnih lastnosti.
Keywords: Alcohol screening and brief intervention; Cognitive testing; Content validity; Motivational interviewing; Self-assessment questionnaire.
© 2024 Tadeja HOČEVAR et al., published by Sciendo.