How Hearing Impaired People View Closed Captions of TV Commercials Measured By Eye-Tracking Device

Takahiro Fukushima 1 *, Takashi Yasuda 2, Mika Oda 2

More Detail


We conduct experiments to measure effects of various types of closed captions for Japanese TV commercials using eye-tracking device. The experiment materials are real TV commercials, and 92 hearing impaired people participate in the experiments. We prepare six TV commercials, each of them captioned in four different ways: no closed captions and three types of captions, which are fully captioned (horizontal), partially captioned (horizontal), and fully captioned vertically. The participants watch them in silence using eye-tracking device, accompanied by a questionnaire asking about caption readability for two CMs. We define Areas of Interest (AOIs) as the caption lines and record fixation counts in AOIs and visit counts to AOIs. The results show that there are no statistically significant differences among the three types of captions on both fixation and visit counts, which means the participants watch the CMs similarly. However, further analyses of the data suggest some characteristics of the way the hearing impaired participants view the CM captions. The questionnaire reveals that there are significant differences among the three types of captions for a detergent CM, where partially captioned CM scores higher than the others in readability.



This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Article Type: Research Article

Online Journal of Communication and Media Technologies, Volume 5, Issue September 2015 - Special Issue, pp. 43-52

Published Online: 01 Sep 2015

Article Views: 352

Article Downloads: 112

Open Access References How to Cite This Article