The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and Sense
<p/> <p>The catchment feature model addresses two questions in the field of multimodal interaction: how we bridge video and audio processing with the realities of human multimodal communication, and how information from the different modes may be fused. We argue from a detailed literatur...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2004-01-01
|
| Series: | EURASIP Journal on Advances in Signal Processing |
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1155/S1110865704405101 |
| _version_ | 1817992168728428544 |
|---|---|
| author | Quek Francis |
| author_facet | Quek Francis |
| author_sort | Quek Francis |
| collection | DOAJ |
| description | <p/> <p>The catchment feature model addresses two questions in the field of multimodal interaction: how we bridge video and audio processing with the realities of human multimodal communication, and how information from the different modes may be fused. We argue from a detailed literature review that gestural research has clustered around manipulative and semaphoric use of the hands, motivate the catchment feature model psycholinguistic research, and present the model. In contrast to “whole gesture” recognition, the catchment feature model applies a feature decomposition approach that facilitates cross-modal fusion at the level of discourse planning and conceptualization. We present our experimental framework for catchment feature-based research, cite three concrete examples of catchment features, and propose new directions of multimodal research based on the model.</p> |
| first_indexed | 2024-04-14T01:22:55Z |
| format | Article |
| id | doaj.art-c4416201baaa42dd9f2a9c3f76fd5120 |
| institution | Directory Open Access Journal |
| issn | 1687-6172 1687-6180 |
| language | English |
| last_indexed | 2024-04-14T01:22:55Z |
| publishDate | 2004-01-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | EURASIP Journal on Advances in Signal Processing |
| spelling | doaj.art-c4416201baaa42dd9f2a9c3f76fd51202022-12-22T02:20:34ZengSpringerOpenEURASIP Journal on Advances in Signal Processing1687-61721687-61802004-01-01200411769219The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and SenseQuek Francis<p/> <p>The catchment feature model addresses two questions in the field of multimodal interaction: how we bridge video and audio processing with the realities of human multimodal communication, and how information from the different modes may be fused. We argue from a detailed literature review that gestural research has clustered around manipulative and semaphoric use of the hands, motivate the catchment feature model psycholinguistic research, and present the model. In contrast to “whole gesture” recognition, the catchment feature model applies a feature decomposition approach that facilitates cross-modal fusion at the level of discourse planning and conceptualization. We present our experimental framework for catchment feature-based research, cite three concrete examples of catchment features, and propose new directions of multimodal research based on the model.</p>http://dx.doi.org/10.1155/S1110865704405101multimodal interactiongesture interactionmultimodal communicationsmotion symmetriesgesture space use |
| spellingShingle | Quek Francis The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and Sense EURASIP Journal on Advances in Signal Processing multimodal interaction gesture interaction multimodal communications motion symmetries gesture space use |
| title | The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and Sense |
| title_full | The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and Sense |
| title_fullStr | The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and Sense |
| title_full_unstemmed | The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and Sense |
| title_short | The Catchment Feature Model: A Device for Multimodal Fusion and a Bridge between Signal and Sense |
| title_sort | catchment feature model a device for multimodal fusion and a bridge between signal and sense |
| topic | multimodal interaction gesture interaction multimodal communications motion symmetries gesture space use |
| url | http://dx.doi.org/10.1155/S1110865704405101 |
| work_keys_str_mv | AT quekfrancis thecatchmentfeaturemodeladeviceformultimodalfusionandabridgebetweensignalandsense AT quekfrancis catchmentfeaturemodeladeviceformultimodalfusionandabridgebetweensignalandsense |