Smart subtitles for vocabulary learning

Language learners often use subtitled videos to help them learn. However, standard subtitles are geared more towards comprehension than vocabulary learning, as translations are nonliteral and are provided only for phrases, not vocabulary. This paper presents Smart Subtitles, which are interactive su...

Full description

Bibliographic Details
Main Authors: Kovacs, Geza, Miller, Robert C.
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:en_US
Published: Association for Computing Machinery (ACM) 2014
Online Access:http://hdl.handle.net/1721.1/90411
https://orcid.org/0000-0002-0442-691X
_version_ 1826203850848075776
author Kovacs, Geza
Miller, Robert C.
author2 Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
author_facet Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Kovacs, Geza
Miller, Robert C.
author_sort Kovacs, Geza
collection MIT
description Language learners often use subtitled videos to help them learn. However, standard subtitles are geared more towards comprehension than vocabulary learning, as translations are nonliteral and are provided only for phrases, not vocabulary. This paper presents Smart Subtitles, which are interactive subtitles tailored towards vocabulary learning. Smart Subtitles can be automatically generated from common video sources such as subtitled DVDs. They provide features such as vocabulary definitions on hover, and dialog-based video navigation. In our pilot study with intermediate learners studying Chinese, participants correctly defined over twice as many new words in a post-viewing vocabulary test when they used Smart Subtitles, compared to dual Chinese-English subtitles. Learners spent the same amount of time watching clips with each tool, and enjoyed viewing videos with Smart Subtitles as much as with dual subtitles. Learners understood videos equally well using either tool, as indicated by self-assessments and independent evaluations of their summaries.
first_indexed 2024-09-23T12:44:36Z
format Article
id mit-1721.1/90411
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T12:44:36Z
publishDate 2014
publisher Association for Computing Machinery (ACM)
record_format dspace
spelling mit-1721.1/904112022-09-28T09:46:24Z Smart subtitles for vocabulary learning Kovacs, Geza Miller, Robert C. Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Miller, Robert C. Language learners often use subtitled videos to help them learn. However, standard subtitles are geared more towards comprehension than vocabulary learning, as translations are nonliteral and are provided only for phrases, not vocabulary. This paper presents Smart Subtitles, which are interactive subtitles tailored towards vocabulary learning. Smart Subtitles can be automatically generated from common video sources such as subtitled DVDs. They provide features such as vocabulary definitions on hover, and dialog-based video navigation. In our pilot study with intermediate learners studying Chinese, participants correctly defined over twice as many new words in a post-viewing vocabulary test when they used Smart Subtitles, compared to dual Chinese-English subtitles. Learners spent the same amount of time watching clips with each tool, and enjoyed viewing videos with Smart Subtitles as much as with dual subtitles. Learners understood videos equally well using either tool, as indicated by self-assessments and independent evaluations of their summaries. 2014-09-26T18:08:37Z 2014-09-26T18:08:37Z 2014-04 Article http://purl.org/eprint/type/ConferencePaper 9781450324731 http://hdl.handle.net/1721.1/90411 Geza Kovacs and Robert C. Miller. 2014. Smart subtitles for vocabulary learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 853-862. https://orcid.org/0000-0002-0442-691X en_US http://dx.doi.org/10.1145/2556288.2557256 Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Association for Computing Machinery (ACM) MIT web domain
spellingShingle Kovacs, Geza
Miller, Robert C.
Smart subtitles for vocabulary learning
title Smart subtitles for vocabulary learning
title_full Smart subtitles for vocabulary learning
title_fullStr Smart subtitles for vocabulary learning
title_full_unstemmed Smart subtitles for vocabulary learning
title_short Smart subtitles for vocabulary learning
title_sort smart subtitles for vocabulary learning
url http://hdl.handle.net/1721.1/90411
https://orcid.org/0000-0002-0442-691X
work_keys_str_mv AT kovacsgeza smartsubtitlesforvocabularylearning
AT millerrobertc smartsubtitlesforvocabularylearning