Test-Retest Reliability and Responsiveness of the Computerized Adaptive Test of Social Functioning in Persons With Stroke

Hsin-Yu Chiang; Po-Ting Chen; Shih-Chieh Lee; Yun-Jer Shieh; I-Ping Hsueh; Ching-Lin Hsieh

doi:10.1016/j.apmr.2023.03.017

Test-Retest Reliability and Responsiveness of the Computerized Adaptive Test of Social Functioning in Persons With Stroke

Arch Phys Med Rehabil. 2023 Sep;104(9):1432-1438. doi: 10.1016/j.apmr.2023.03.017. Epub 2023 Apr 5.

Authors

Hsin-Yu Chiang¹, Po-Ting Chen², Shih-Chieh Lee³, Yun-Jer Shieh⁴, I-Ping Hsueh⁵, Ching-Lin Hsieh⁶

Affiliations

¹ Department of Occupational Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan.
² Hualien Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Hualien; School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan.
³ Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan; Institute of Long-Term Care, MacKay Medical College, New Taipei City; Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan; Department of Psychiatry, National Taiwan University Hospital, Taipei, Taiwan.
⁴ School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan.
⁵ School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan; Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan.
⁶ School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan; Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan; Department of Occupational Therapy, College of Medical and Health Science, Asia University, Taichung, Taiwan. Electronic address: clhsieh@ntu.edu.tw.

PMID: 37028696
DOI: 10.1016/j.apmr.2023.03.017

Abstract

Objective: To examine the test-retest reliability, minimal detectable change (MDC), responsiveness, and efficiency of the Computerized Adaptive Test of Social Functioning (Social-CAT) in patients with stroke.

Design: Repeated-assessments design.

Setting: A department of rehabilitation of a medical center.

Participants: In total, 31 patients with chronic stroke and 65 patients with subacute stroke were recruited.

Intervention: Not available.

Main outcome measure: Social-CAT.

Results: The Social-CAT showed acceptable test-retest reliability (intraclass correlation coefficient, 0.80) and small random measurement error (MDC%: 18.0%). However, heteroscedasticity was found (r between the means and the absolute change scores: 0.32), so the MDC% adjusted cut-off score is recommended for determining real improvement. Regarding responsiveness, the Social-CAT showed large differences (Kazis' effect size and standardized mean response: 1.15 and 1.09, respectively) in subacute patients. Regarding efficiency, the Social-CAT required an average of 5 items and less than 2 minutes for completion.

Conclusions: Our findings indicate that the Social-CAT is a reliable and efficient measure with good test-retest reliability, small random measurement error, and good responsiveness. Thus, the Social-CAT is a useful outcome measure for routine monitoring of the changes in social function of patients with stroke.

Keywords: Health Care; Outcome Assessment; Patient Reported Outcome Measures; Psychometrics; Rehabilitation; Stroke.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Activities of Daily Living
Disability Evaluation
Humans
Reproducibility of Results
Social Interaction
Stroke Rehabilitation*
Stroke*