A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization
We propose a multi-modal perceptual system that is inspired by the inner working of the human brain; in particular, the hierarchical structure of the sensory cortex and the spatial-temporal binding criteria. The system is context independent and can be applied to many on-going problems in social rob...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2018-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8400512/ |
| _version_ | 1819162754080047104 |
|---|---|
| author | Mohammad K. Al-Qaderi Ahmad B. Rad |
| author_facet | Mohammad K. Al-Qaderi Ahmad B. Rad |
| author_sort | Mohammad K. Al-Qaderi |
| collection | DOAJ |
| description | We propose a multi-modal perceptual system that is inspired by the inner working of the human brain; in particular, the hierarchical structure of the sensory cortex and the spatial-temporal binding criteria. The system is context independent and can be applied to many on-going problems in social robotics, including but not limited to person recognition, emotion recognition, and multi-modal robot doctor to name a few. The system encapsulates the parallel distributed processing of real-world stimuli through different sensor modalities and encoding them into features vectors which in turn are processed via a number of dedicated processing units (DPUs) through hierarchical paths. DPUs are algorithmic realizations of the cell assemblies in neuroscience. A plausible and realistic perceptual system is presented via the integration of the outputs from these units by spiking neural networks. We will also discuss other components of the system including top-down influences and the integration of information through temporal binding with fading memory and suggest two alternatives to realize these criteria. Finally, we will demonstrate the implementation of this architecture on a hardware platform as a social robot and report experimental studies on the system. |
| first_indexed | 2024-12-22T17:33:15Z |
| format | Article |
| id | doaj.art-f79703d3fe824ed7b2e8250f924c7fa5 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-22T17:33:15Z |
| publishDate | 2018-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-f79703d3fe824ed7b2e8250f924c7fa52022-12-21T18:18:34ZengIEEEIEEE Access2169-35362018-01-016354023542410.1109/ACCESS.2018.28518418400512A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental RealizationMohammad K. Al-Qaderi0Ahmad B. Rad1https://orcid.org/0000-0002-8477-7567Autonomous and Intelligent Systems Laboratory, School of Mechatronic Systems Engineering, Simon Fraser University, Surrey Campus, Surrey, BC, CanadaAutonomous and Intelligent Systems Laboratory, School of Mechatronic Systems Engineering, Simon Fraser University, Surrey Campus, Surrey, BC, CanadaWe propose a multi-modal perceptual system that is inspired by the inner working of the human brain; in particular, the hierarchical structure of the sensory cortex and the spatial-temporal binding criteria. The system is context independent and can be applied to many on-going problems in social robotics, including but not limited to person recognition, emotion recognition, and multi-modal robot doctor to name a few. The system encapsulates the parallel distributed processing of real-world stimuli through different sensor modalities and encoding them into features vectors which in turn are processed via a number of dedicated processing units (DPUs) through hierarchical paths. DPUs are algorithmic realizations of the cell assemblies in neuroscience. A plausible and realistic perceptual system is presented via the integration of the outputs from these units by spiking neural networks. We will also discuss other components of the system including top-down influences and the integration of information through temporal binding with fading memory and suggest two alternatives to realize these criteria. Finally, we will demonstrate the implementation of this architecture on a hardware platform as a social robot and report experimental studies on the system.https://ieeexplore.ieee.org/document/8400512/Human-robot interactionmachine perceptionmulti-modal systemssocial robotsspiking neural networkstop-down influences |
| spellingShingle | Mohammad K. Al-Qaderi Ahmad B. Rad A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization IEEE Access Human-robot interaction machine perception multi-modal systems social robots spiking neural networks top-down influences |
| title | A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization |
| title_full | A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization |
| title_fullStr | A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization |
| title_full_unstemmed | A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization |
| title_short | A Brain-Inspired Multi-Modal Perceptual System for Social Robots: An Experimental Realization |
| title_sort | brain inspired multi modal perceptual system for social robots an experimental realization |
| topic | Human-robot interaction machine perception multi-modal systems social robots spiking neural networks top-down influences |
| url | https://ieeexplore.ieee.org/document/8400512/ |
| work_keys_str_mv | AT mohammadkalqaderi abraininspiredmultimodalperceptualsystemforsocialrobotsanexperimentalrealization AT ahmadbrad abraininspiredmultimodalperceptualsystemforsocialrobotsanexperimentalrealization AT mohammadkalqaderi braininspiredmultimodalperceptualsystemforsocialrobotsanexperimentalrealization AT ahmadbrad braininspiredmultimodalperceptualsystemforsocialrobotsanexperimentalrealization |