Is Retell a Valid Measure of Reading Comprehension?

Educ Res Rev. 2021 Feb:32:100375. doi: 10.1016/j.edurev.2020.100375. Epub 2020 Dec 15.

Abstract

Retell is used widely as a measure of reading comprehension. In this meta-analysis, we evaluated the relation between retell and other measures of reading comprehension among students in Grades 1-12. Data from 23 studies (82 effect sizes; N = 4,705 participants) showed a moderate relation between retell and other measures of reading comprehension, r = .46. Moderation analyses revealed that the relation was stronger when reading comprehension was measured by cloze or maze tasks than when measured using a multiple-choice format. In addition, the relation was weaker in higher grades, but this was largely explained by text genre or the number of prompts in retell. The relation between 'oral' retell and reading comprehension was stronger with a greater number of prompts provided during retell tests. In contrast, results did not differ by other features of retell such as reading mode (oral or silent), text genres of retell (narrative or informational), or use of different oral retell evaluation methods (e.g., number of words or ideas, overall quality). Overall, the results indicate a moderate relation, on average, between retell and other measures of reading comprehension. However, the moderate magnitude indicates caution for using retell as the sole measure of reading comprehension. The results also indicate a need for a better understanding about more systematic approaches to retell assessment (e.g., number and kind of prompts in the case of oral retell) as a measure of reading comprehension.

Keywords: assessment; meta-analysis; moderators; reading comprehension; retell.