Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia
Abstract Multimedia is extensively used for educational purposes. However, certain types of multimedia lack proper design, which could impose a cognitive load on the user. Therefore, it is essential to predict cognitive load and understand how it impairs brain functioning. Participants watched a ver...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-04-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-024-59411-x |
| _version_ | 1797199548005744640 |
|---|---|
| author | Amir Hosein Asaadi S. Hamid Amiri Alireza Bosaghzadeh Reza Ebrahimpour |
| author_facet | Amir Hosein Asaadi S. Hamid Amiri Alireza Bosaghzadeh Reza Ebrahimpour |
| author_sort | Amir Hosein Asaadi |
| collection | DOAJ |
| description | Abstract Multimedia is extensively used for educational purposes. However, certain types of multimedia lack proper design, which could impose a cognitive load on the user. Therefore, it is essential to predict cognitive load and understand how it impairs brain functioning. Participants watched a version of educational multimedia that applied Mayer’s principles, followed by a version that did not. Meanwhile, their electroencephalography (EEG) was recorded. Subsequently, they participated in a post-test and completed a self-reported cognitive load questionnaire. The audio envelope and word frequency were extracted from the multimedia, and the temporal response functions (TRFs) were obtained using a linear encoding model. We observed that the behavioral data are different between the two groups and the TRFs of the two multimedia versions were different. We saw changes in the amplitude and latencies of both early and late components. In addition, correlations were found between behavioral data and the amplitude and latencies of TRF components. Cognitive load decreased participants’ attention to the multimedia, and semantic processing of words also occurred with a delay and smaller amplitude. Hence, encoding models provide insights into the temporal and spatial mapping of the cognitive load activity, which could help us detect and reduce cognitive load in potential environments such as educational multimedia or simulators for different purposes. |
| first_indexed | 2024-04-24T07:17:30Z |
| format | Article |
| id | doaj.art-7c91c2b2c2e34257a3ae5108619b22f2 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-04-24T07:17:30Z |
| publishDate | 2024-04-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-7c91c2b2c2e34257a3ae5108619b22f22024-04-21T11:14:10ZengNature PortfolioScientific Reports2045-23222024-04-0114111310.1038/s41598-024-59411-xEffects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimediaAmir Hosein Asaadi0S. Hamid Amiri1Alireza Bosaghzadeh2Reza Ebrahimpour3Department of Computer Engineering, Shahid Rajaee Teacher Training UniversityDepartment of Computer Engineering, Shahid Rajaee Teacher Training UniversityDepartment of Computer Engineering, Shahid Rajaee Teacher Training UniversityCenter for Cognitive Science, Institute for Convergence Science and Technology (ICST), Sharif University of TechnologyAbstract Multimedia is extensively used for educational purposes. However, certain types of multimedia lack proper design, which could impose a cognitive load on the user. Therefore, it is essential to predict cognitive load and understand how it impairs brain functioning. Participants watched a version of educational multimedia that applied Mayer’s principles, followed by a version that did not. Meanwhile, their electroencephalography (EEG) was recorded. Subsequently, they participated in a post-test and completed a self-reported cognitive load questionnaire. The audio envelope and word frequency were extracted from the multimedia, and the temporal response functions (TRFs) were obtained using a linear encoding model. We observed that the behavioral data are different between the two groups and the TRFs of the two multimedia versions were different. We saw changes in the amplitude and latencies of both early and late components. In addition, correlations were found between behavioral data and the amplitude and latencies of TRF components. Cognitive load decreased participants’ attention to the multimedia, and semantic processing of words also occurred with a delay and smaller amplitude. Hence, encoding models provide insights into the temporal and spatial mapping of the cognitive load activity, which could help us detect and reduce cognitive load in potential environments such as educational multimedia or simulators for different purposes.https://doi.org/10.1038/s41598-024-59411-xEEGEducational multimediaForward encoding modelsTemporal response functionCognitive load |
| spellingShingle | Amir Hosein Asaadi S. Hamid Amiri Alireza Bosaghzadeh Reza Ebrahimpour Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia Scientific Reports EEG Educational multimedia Forward encoding models Temporal response function Cognitive load |
| title | Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia |
| title_full | Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia |
| title_fullStr | Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia |
| title_full_unstemmed | Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia |
| title_short | Effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia |
| title_sort | effects and prediction of cognitive load on encoding model of brain response to auditory and linguistic stimuli in educational multimedia |
| topic | EEG Educational multimedia Forward encoding models Temporal response function Cognitive load |
| url | https://doi.org/10.1038/s41598-024-59411-x |
| work_keys_str_mv | AT amirhoseinasaadi effectsandpredictionofcognitiveloadonencodingmodelofbrainresponsetoauditoryandlinguisticstimuliineducationalmultimedia AT shamidamiri effectsandpredictionofcognitiveloadonencodingmodelofbrainresponsetoauditoryandlinguisticstimuliineducationalmultimedia AT alirezabosaghzadeh effectsandpredictionofcognitiveloadonencodingmodelofbrainresponsetoauditoryandlinguisticstimuliineducationalmultimedia AT rezaebrahimpour effectsandpredictionofcognitiveloadonencodingmodelofbrainresponsetoauditoryandlinguisticstimuliineducationalmultimedia |