Toward an infrastructure for data-driven multimodal communication research

Research into the multimodal dimensions of human communication faces a set of distinctive methodological challenges. Collecting the datasets is resource-intensive, analysis often lacks peer validation, and the absence of shared datasets makes it difficult to develop standards. External validity is h...

Full description

Bibliographic Details
Main Authors: Steen, F, Hougaard, A, Joo, J, Olza, I, Pagán Cánovas, C, Pleshakova, A, Ray, S, Uhrig, P, Wozny, J, Turner, M
Format: Journal article
Published: De Gruyter 2018
_version_ 1797064783250325504
author Steen, F
Hougaard, A
Joo, J
Olza, I
Pagán Cánovas, C
Pleshakova, A
Ray, S
Uhrig, P
Wozny, J
Turner, M
author_facet Steen, F
Hougaard, A
Joo, J
Olza, I
Pagán Cánovas, C
Pleshakova, A
Ray, S
Uhrig, P
Wozny, J
Turner, M
author_sort Steen, F
collection OXFORD
description Research into the multimodal dimensions of human communication faces a set of distinctive methodological challenges. Collecting the datasets is resource-intensive, analysis often lacks peer validation, and the absence of shared datasets makes it difficult to develop standards. External validity is hampered by small datasets, yet large datasets are intractable. Red Hen Lab spearheads an international infrastructure for data-driven multimodal communication research, facilitating an integrated cross-disciplinary workflow. Linguists, communication scholars, statisticians, and computer scientists work together to develop research questions, annotate training sets, and develop pattern discovery and machine learning tools that handle vast collections of multimodal data, beyond the dreams of previous researchers. This infrastructure makes it possible for researchers at multiple sites to work in real-time in transdisciplinary teams. We review the vision, progress, and prospects of this research consortium.
first_indexed 2024-03-06T21:19:18Z
format Journal article
id oxford-uuid:40e2e2d5-6016-4454-9400-d7fec52e4c31
institution University of Oxford
last_indexed 2024-03-06T21:19:18Z
publishDate 2018
publisher De Gruyter
record_format dspace
spelling oxford-uuid:40e2e2d5-6016-4454-9400-d7fec52e4c312022-03-26T14:40:25ZToward an infrastructure for data-driven multimodal communication researchJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:40e2e2d5-6016-4454-9400-d7fec52e4c31Symplectic Elements at OxfordDe Gruyter2018Steen, FHougaard, AJoo, JOlza, IPagán Cánovas, CPleshakova, ARay, SUhrig, PWozny, JTurner, MResearch into the multimodal dimensions of human communication faces a set of distinctive methodological challenges. Collecting the datasets is resource-intensive, analysis often lacks peer validation, and the absence of shared datasets makes it difficult to develop standards. External validity is hampered by small datasets, yet large datasets are intractable. Red Hen Lab spearheads an international infrastructure for data-driven multimodal communication research, facilitating an integrated cross-disciplinary workflow. Linguists, communication scholars, statisticians, and computer scientists work together to develop research questions, annotate training sets, and develop pattern discovery and machine learning tools that handle vast collections of multimodal data, beyond the dreams of previous researchers. This infrastructure makes it possible for researchers at multiple sites to work in real-time in transdisciplinary teams. We review the vision, progress, and prospects of this research consortium.
spellingShingle Steen, F
Hougaard, A
Joo, J
Olza, I
Pagán Cánovas, C
Pleshakova, A
Ray, S
Uhrig, P
Wozny, J
Turner, M
Toward an infrastructure for data-driven multimodal communication research
title Toward an infrastructure for data-driven multimodal communication research
title_full Toward an infrastructure for data-driven multimodal communication research
title_fullStr Toward an infrastructure for data-driven multimodal communication research
title_full_unstemmed Toward an infrastructure for data-driven multimodal communication research
title_short Toward an infrastructure for data-driven multimodal communication research
title_sort toward an infrastructure for data driven multimodal communication research
work_keys_str_mv AT steenf towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT hougaarda towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT jooj towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT olzai towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT pagancanovasc towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT pleshakovaa towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT rays towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT uhrigp towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT woznyj towardaninfrastructurefordatadrivenmultimodalcommunicationresearch
AT turnerm towardaninfrastructurefordatadrivenmultimodalcommunicationresearch