A Multimodal Assignment That Enriches Literacy Learning The Problem by Timothy Oldakowski

“…This article demonstrates the value of multimodal learning (the use of more than one mode) as a means for student expression, specifically in responding to young adult literature. …”

Neural techniques for modeling visually grounded speech by Leidal, Kenneth (Kenneth Knute)

Get full text

DESEM: Depthwise Separable Convolution-Based Multimodal Deep Learning for In-Game Action Anticipation by Changhyun Kim, Jinsoo Bae, Insung Baek, Jaeyoon Jeong, Young Jae Lee, Kiwoong Park, Sang Heun Shim, Seoung Bum Kim

“…DESEM performs multimodal learning using high-dimensional frames and action labels simultaneously as inputs. …”
Get full text

Disembodied AI and the limits to machine understanding of students' embodied interactions by Mitchell J. Nathan

“…The embodiment turn in the Learning Sciences has fueled growth of multimodal learning analytics to understand embodied interactions and make consequential educational decisions about students more rapidly, more accurately, and more personalized than ever before. …”
Get full text

Learning transferable cross-modality representations for few-shot hyperspectral and LiDAR collaborative classification by Mofan Dai, Shuai Xing, Qing Xu, Hanyun Wang, Pengcheng Li, Yifan Sun, Jiechen Pan, Yuqiong Li

“…Specifically, the MFRN-ML incorporates the multimodal learning and few-shot learning (FSL) into a three-stage task-based learning framework to learn the transferable cross-modality representations for few-shot HSI and LiDAR collaborative classification. …”
Get full text

Students’ VARK Learning Style in Digital Content Writing by Nur Rosita, Nora Fudhla

“…It is found that the students tend to use multimodal learning style in creating digital content writing. …”
Get full text

Embodied learning made visible through line drawing by Elisabet Jagell

“…Research ethics requirements pose a challenge in terms of making younger students’ multimodal learning visible, as the informants need to be anonymized, and this raises the challenge of how important information, such as gaze and facial expressions, can be shown. …”
Get full text

Detecting Multimodal Behaviors for Neurodegenerative Disease by Berrones, Antonio

“…This thesis will develop a framework for processing collected participant eye-tracking and handwriting data and show its use in detecting specific multimodal learning behaviors. Furthermore, this thesis will explore recommendations for working with eye-tracking systems and outline future steps towards developing a multimodal classification model to automate early diagnosis of neurodegenerative disease.…”
Get full text

Study of machine learning techniques for disease detection in the eye by Yogaindran S/O Murugan

“…This project will investigate segmentation techniques for OCT angiography and multimodal learning for comprehensive retinal diseases detection and diagnosis.…”
Get full text

Relating by contrasting: A data-efficient framework for multimodal DGMs by Shi, Y, Paige, B, Torr, PHS, Siddharth, N

“…Multimodal learning for generative models often refers to the learning of abstract concepts from the commonality of information in multiple modalities, such as vision and language. …”

Innovation of Assistive Technologies in Special Education: A Review by Anna Felicia, Sabariah Sharif, W. K. Wong, Muralindran Marriappan

“…Assistive technologies further serves as a problem-solving tool or medium that enhanced learning via many factors such as critical thinking, multimodal learning and motivational approaches. The targeted goal of the paper, therefore, is to stimulate the discussion of assistive technologies as the innovation in education based on current research and practical applications.…”
Get full text

Multimodal integration for Barrett’s esophagus by Shubin Liu, Shiyu Peng, Mengxuan Zhang, Ziyuan Wang, Lei Li

“…Inspired by the principle of collaboration between human eye vision and brain cortex in data processing, here we propose multimodal learning framework to tackle tasks from various modalities, which can benefit from each other. …”
Get full text

The Communicative Effectiveness of Education Videos: Towards an Empirically-Motivated Multimodal Account by John A. Bateman, Florian Schmidt-Borcherding

“…We situate these results with respect to the state of the art in cognitive research in multimodal learning and argue that the more complex multimodal interactions and artifacts become, the more a fine-grained view of multimodal communication of the kind we propose will be essential for engaging with such media, both theoretically and empirically.…”
Get full text

Multimodal teaching analytics: the application of SCORM courseware technology integrating 360-degree panoramic VR in historical courses by Yanxiang Zhang, Ya Wang, Guimin Fan, Yi Song, Yunfeng Hu

“…These media elements are used to provide learners with a multimodal learning experience in history courses. We monitor the learning effects using EEG and questionnaires. …”
Get full text

Bidirectional generation of structure and properties through a single molecular foundation model by Jinho Chang, Jong Chul Ye

“…To address this, here we present a multimodal molecular pre-trained model that incorporates the modalities of structure and biochemical properties, drawing inspiration from recent advances in multimodal learning techniques. Our proposed model pipeline of data handling and training objectives aligns the structure/property features in a common embedding space, which enables the model to regard bidirectional information between the molecules’ structure and properties. …”
Get full text

Multimodal Lifeworlds: Pedagogies for Play Inquiries and Explorations by Lorna Arnott, Nicola J. Yelland

“…We contend that, in order to make our work accessible, and to describe the ways in which digital artefacts can create new contexts for learning, we should foreground the learning that is possible in contemporary multimodal learning ecologies. We raise complex questions and issues that require consideration as we plan for pedagogies that will encourage, support and transform children’s learning. …”
Get full text

A Multimodal Ensemble Driven by Multiobjective Optimisation to Predict Overall Survival in Non-Small-Cell Lung Cancer by Camillo Maria Caruso, Valerio Guarrasi, Ermanno Cordelli, Rosa Sicilia, Silvia Gentile, Laura Messina, Michele Fiore, Claudia Piccolo, Bruno Beomonte Zobel, Giulio Iannello, Sara Ramella, Paolo Soda

“…To predict overall survival, in this work, we investigate the use of multimodal learning on the CLARO dataset, which includes CT images and clinical data collected from a cohort of non-small-cell lung cancer patients. …”
Get full text

Advanced Sensors Technology in Education by Rubén González Crespo, Daniel Burgos

“…Using depth cameras to detect patterns in oral presentations, or improving the assessment of agility through low cost-sensors with multimodal learning analytics, or using computing devices as sensors to measure their impact on primary and secondary students’ performances are the focus of this study as well. …”
Get full text

Learning Multimodality through Genre-Based Multimodal Texts Analysis: Listening to Students’ Voices by Fuad Abdullah, Soni Tantan Tandiana, Yuyus Saputra

“…The findings reveal that the students perceived GBMTA as facilitating them in the building of multimodal discourse analysis, challenges and solutions of comprehending multimodal teaching materials, planning better learning strategies in the future, engagement on multimodal learning issues, and multimodal text analysis practices. …”
Get full text

Data-Driven Artificial Intelligence Recommendation Mechanism in Online Learning Resources by Lina Yang, Yawen Yu, Yonghong Wei

“…The “multimodal data fusion” aspect is adopted, illustrating online learning resource modeling, learning preference modeling, learning preference evolution, and referral engine smart design. Multimodal learning resources are key constituents of multidimensional intelligent recommendation services. …”
Get full text