Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression
Humans have an extraordinary ability to recognize facial expression and identity from a single face simultaneously and effortlessly, however, the underlying neural computation is not well understood. Here, we optimized a multi-task deep neural network to classify facial expression and identity simul...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2022-12-01
|
| Series: | NeuroImage |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1053811922008904 |
| _version_ | 1811201299984678912 |
|---|---|
| author | Xuetong Ding Hui Zhang |
| author_facet | Xuetong Ding Hui Zhang |
| author_sort | Xuetong Ding |
| collection | DOAJ |
| description | Humans have an extraordinary ability to recognize facial expression and identity from a single face simultaneously and effortlessly, however, the underlying neural computation is not well understood. Here, we optimized a multi-task deep neural network to classify facial expression and identity simultaneously. Under various optimization training strategies, the best-performing model consistently showed ‘share-separate’ organization. The two separate branches of the best-performing model also exhibited distinct abilities to categorize facial expression and identity, and these abilities increased along the facial expression or identity branches toward high layers. By comparing the representational similarities between the best-performing model and functional magnetic resonance imaging (fMRI) responses in the human visual cortex to the same face stimuli, the face-selective posterior superior temporal sulcus (pSTS) in the dorsal visual cortex was significantly correlated with layers in the expression branch of the model, and the anterior inferotemporal cortex (aIT) and anterior fusiform face area (aFFA) in the ventral visual cortex were significantly correlated with layers in the identity branch of the model. Besides, the aFFA and aIT better matched the high layers of the model, while the posterior FFA (pFFA) and occipital facial area (OFA) better matched the middle and early layers of the model, respectively. Overall, our study provides a task-optimization computational model to better understand the neural mechanism underlying face recognition, which suggest that similar to the best-performing model, the human visual system exhibits both dissociated and hierarchical neuroanatomical organization when simultaneously coding facial identity and expression. |
| first_indexed | 2024-04-12T02:19:39Z |
| format | Article |
| id | doaj.art-134254a023b14a8bb3381352aa38e382 |
| institution | Directory Open Access Journal |
| issn | 1095-9572 |
| language | English |
| last_indexed | 2024-04-12T02:19:39Z |
| publishDate | 2022-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | NeuroImage |
| spelling | doaj.art-134254a023b14a8bb3381352aa38e3822022-12-22T03:52:09ZengElsevierNeuroImage1095-95722022-12-01264119769Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expressionXuetong Ding0Hui Zhang1School of Engineering Medicine, Beihang University, Beijing 100191, China; School of Biological Science and Medical Engineering, Beihang University, Beijing 100191, China; Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Beijing 100191, ChinaSchool of Engineering Medicine, Beihang University, Beijing 100191, China; Key Laboratory of Biomechanics and Mechanobiology (Beihang University), Ministry of Education, Beijing 100191, China; Corresponding author.Humans have an extraordinary ability to recognize facial expression and identity from a single face simultaneously and effortlessly, however, the underlying neural computation is not well understood. Here, we optimized a multi-task deep neural network to classify facial expression and identity simultaneously. Under various optimization training strategies, the best-performing model consistently showed ‘share-separate’ organization. The two separate branches of the best-performing model also exhibited distinct abilities to categorize facial expression and identity, and these abilities increased along the facial expression or identity branches toward high layers. By comparing the representational similarities between the best-performing model and functional magnetic resonance imaging (fMRI) responses in the human visual cortex to the same face stimuli, the face-selective posterior superior temporal sulcus (pSTS) in the dorsal visual cortex was significantly correlated with layers in the expression branch of the model, and the anterior inferotemporal cortex (aIT) and anterior fusiform face area (aFFA) in the ventral visual cortex were significantly correlated with layers in the identity branch of the model. Besides, the aFFA and aIT better matched the high layers of the model, while the posterior FFA (pFFA) and occipital facial area (OFA) better matched the middle and early layers of the model, respectively. Overall, our study provides a task-optimization computational model to better understand the neural mechanism underlying face recognition, which suggest that similar to the best-performing model, the human visual system exhibits both dissociated and hierarchical neuroanatomical organization when simultaneously coding facial identity and expression.http://www.sciencedirect.com/science/article/pii/S1053811922008904Multi-task deep neural networkFunctional MRIFacial identityFacial expressionRepresentational similarity analysis |
| spellingShingle | Xuetong Ding Hui Zhang Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression NeuroImage Multi-task deep neural network Functional MRI Facial identity Facial expression Representational similarity analysis |
| title | Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression |
| title_full | Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression |
| title_fullStr | Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression |
| title_full_unstemmed | Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression |
| title_short | Dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression |
| title_sort | dissociation and hierarchy of human visual pathways for simultaneously coding facial identity and expression |
| topic | Multi-task deep neural network Functional MRI Facial identity Facial expression Representational similarity analysis |
| url | http://www.sciencedirect.com/science/article/pii/S1053811922008904 |
| work_keys_str_mv | AT xuetongding dissociationandhierarchyofhumanvisualpathwaysforsimultaneouslycodingfacialidentityandexpression AT huizhang dissociationandhierarchyofhumanvisualpathwaysforsimultaneouslycodingfacialidentityandexpression |