Objective: To evaluate the methodological quality of research on cognitive rehabilitation after traumatic brain injury (TBI).
Data sources: Secondary analysis of studies identified in prior systematic reviews of cognitive rehabilitation.
Study selection: Randomized controlled trials (RCTs) and observational studies involving exclusively or primarily participants with TBI.
Data extraction: Criteria for evaluating methodological quality were adapted from prior reviews of rehabilitation research. These criteria were modified to be relevant to cognitive rehabilitation research. Sixteen criteria for evaluating the quality of RCTs were applied: 8 relating to the internal validity of studies, 5 descriptive criteria, and 3 statistical criteria. Twelve of these criteria were used to evaluate non-RCT observational studies.
Data synthesis: Thirty-two RCTs and 21 observational studies were independently reviewed and rated by 2 of the authors. Initial agreement between raters for individual studies ranged from 57% to 100%. Interrater reliabilities based on the kappa statistic indicated moderate to substantial agreement.
Conclusions: Several high-quality RCTs support the effectiveness of interventions for attention, communication skills, and executive functioning after TBI. Several high-quality observational studies support the effectiveness of comprehensive-holistic rehabilitation after TBI, including improvements in participation outcomes. The proposed criteria appear useful for evaluating the quality of research on cognitive rehabilitation and improving the design and reporting of future research in this area.