EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study.
Cognitive human error and recent cognitive taxonomy on human error causes of software defects support the intuitive idea that, for instance, mental overload, attention slips, and working memory overload are important human causes for software bugs. In this paper, we approach the EEG as a reliable su...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0299108&type=printable |
| _version_ | 1797263545197395968 |
|---|---|
| author | Júlio Medeiros Marco Simões João Castelhano Rodolfo Abreu Ricardo Couceiro Jorge Henriques Miguel Castelo-Branco Henrique Madeira César Teixeira Paulo de Carvalho |
| author_facet | Júlio Medeiros Marco Simões João Castelhano Rodolfo Abreu Ricardo Couceiro Jorge Henriques Miguel Castelo-Branco Henrique Madeira César Teixeira Paulo de Carvalho |
| author_sort | Júlio Medeiros |
| collection | DOAJ |
| description | Cognitive human error and recent cognitive taxonomy on human error causes of software defects support the intuitive idea that, for instance, mental overload, attention slips, and working memory overload are important human causes for software bugs. In this paper, we approach the EEG as a reliable surrogate to MRI-based reference of the programmer's cognitive state to be used in situations where heavy imaging techniques are infeasible. The idea is to use EEG biomarkers to validate other less intrusive physiological measures, that can be easily recorded by wearable devices and useful in the assessment of the developer's cognitive state during software development tasks. Herein, our EEG study, with the support of fMRI, presents an extensive and systematic analysis by inspecting metrics and extracting relevant information about the most robust features, best EEG channels and the best hemodynamic time delay in the context of software development tasks. From the EEG-fMRI similarity analysis performed, we found significant correlations between a subset of EEG features and the Insula region of the brain, which has been reported as a region highly related to high cognitive tasks, such as software development tasks. We concluded that despite a clear inter-subject variability of the best EEG features and hemodynamic time delay used, the most robust and predominant EEG features, across all the subjects, are related to the Hjorth parameter Activity and Total Power features, from the EEG channels F4, FC4 and C4, and considering in most of the cases a hemodynamic time delay of 4 seconds used on the hemodynamic response function. These findings should be taken into account in future EEG-fMRI studies in the context of software debugging. |
| first_indexed | 2024-04-25T00:14:42Z |
| format | Article |
| id | doaj.art-91a0bf78254044b09603c4e8ec57677c |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-25T00:14:42Z |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-91a0bf78254044b09603c4e8ec57677c2024-03-13T05:31:25ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-01193e029910810.1371/journal.pone.0299108EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study.Júlio MedeirosMarco SimõesJoão CastelhanoRodolfo AbreuRicardo CouceiroJorge HenriquesMiguel Castelo-BrancoHenrique MadeiraCésar TeixeiraPaulo de CarvalhoCognitive human error and recent cognitive taxonomy on human error causes of software defects support the intuitive idea that, for instance, mental overload, attention slips, and working memory overload are important human causes for software bugs. In this paper, we approach the EEG as a reliable surrogate to MRI-based reference of the programmer's cognitive state to be used in situations where heavy imaging techniques are infeasible. The idea is to use EEG biomarkers to validate other less intrusive physiological measures, that can be easily recorded by wearable devices and useful in the assessment of the developer's cognitive state during software development tasks. Herein, our EEG study, with the support of fMRI, presents an extensive and systematic analysis by inspecting metrics and extracting relevant information about the most robust features, best EEG channels and the best hemodynamic time delay in the context of software development tasks. From the EEG-fMRI similarity analysis performed, we found significant correlations between a subset of EEG features and the Insula region of the brain, which has been reported as a region highly related to high cognitive tasks, such as software development tasks. We concluded that despite a clear inter-subject variability of the best EEG features and hemodynamic time delay used, the most robust and predominant EEG features, across all the subjects, are related to the Hjorth parameter Activity and Total Power features, from the EEG channels F4, FC4 and C4, and considering in most of the cases a hemodynamic time delay of 4 seconds used on the hemodynamic response function. These findings should be taken into account in future EEG-fMRI studies in the context of software debugging.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0299108&type=printable |
| spellingShingle | Júlio Medeiros Marco Simões João Castelhano Rodolfo Abreu Ricardo Couceiro Jorge Henriques Miguel Castelo-Branco Henrique Madeira César Teixeira Paulo de Carvalho EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study. PLoS ONE |
| title | EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study. |
| title_full | EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study. |
| title_fullStr | EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study. |
| title_full_unstemmed | EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study. |
| title_short | EEG as a potential ground truth for the assessment of cognitive state in software development activities: A multimodal imaging study. |
| title_sort | eeg as a potential ground truth for the assessment of cognitive state in software development activities a multimodal imaging study |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0299108&type=printable |
| work_keys_str_mv | AT juliomedeiros eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT marcosimoes eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT joaocastelhano eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT rodolfoabreu eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT ricardocouceiro eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT jorgehenriques eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT miguelcastelobranco eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT henriquemadeira eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT cesarteixeira eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy AT paulodecarvalho eegasapotentialgroundtruthfortheassessmentofcognitivestateinsoftwaredevelopmentactivitiesamultimodalimagingstudy |