A Comparison of Comprehension Processes in Sign Language Interpreter Videos with or without Captions

PLoS One. 2015 May 26;10(5):e0127577. doi: 10.1371/journal.pone.0127577. eCollection 2015.

Abstract

One important theme in captioning is whether the implementation of captions in individual sign language interpreter videos can positively affect viewers' comprehension when compared with sign language interpreter videos without captions. In our study, an experiment was conducted using four video clips with information about everyday events. Fifty-one deaf and hard of hearing sign language users alternately watched the sign language interpreter videos with, and without, captions. Afterwards, they answered ten questions. The results showed that the presence of captions positively affected their rates of comprehension, which increased by 24% among deaf viewers and 42% among hard of hearing viewers. The most obvious differences in comprehension between watching sign language interpreter videos with and without captions were found for the subjects of hiking and culture, where comprehension was higher when captions were used. The results led to suggestions for the consistent use of captions in sign language interpreter videos in various media.

Publication types

  • Comparative Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adolescent
  • Adult
  • Aged
  • Comprehension*
  • Female
  • Humans
  • Male
  • Middle Aged
  • Persons With Hearing Impairments*
  • Reading*
  • Sign Language*
  • Television*
  • Young Adult

Grants and funding

Swiss National Science Foundation, Project Number: IZKOZ3_136107 / 1. The "International Short Visits" of the Swiss National Science Foundation (SNSF) allow for researchers working in Switzerland to go abroad or for researchers from elsewhere to come to Switzerland. Dr. Matjaž Debevc visited ETH Zürich and performed the research at this institution.