In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning Capabilities

At present we are witnessing a tremendous interest in Artificial Intelligence (AI), particularly in Deep Learning (DL)/Deep Neural Networks (DNNs). One of the reasons appears to be the unmatched performance achieved by such systems. This has resulted in an enormous hope on such techniques and often...

Full description

Bibliographic Details
Main Author: Nikhil R. Pal
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-06-01
Series:Frontiers in Robotics and AI
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/frobt.2020.00076/full
_version_ 1818501228057853952
author Nikhil R. Pal
author_facet Nikhil R. Pal
author_sort Nikhil R. Pal
collection DOAJ
description At present we are witnessing a tremendous interest in Artificial Intelligence (AI), particularly in Deep Learning (DL)/Deep Neural Networks (DNNs). One of the reasons appears to be the unmatched performance achieved by such systems. This has resulted in an enormous hope on such techniques and often these are viewed as all—cure solutions. But most of these systems cannot explain why a particular decision is made (black box) and sometimes miserably fail in cases where other systems would not. Consequently, in critical applications such as healthcare and defense practitioners do not like to trust such systems. Although an AI system is often designed taking inspiration from the brain, there is not much attempt to exploit cues from the brain in true sense. In our opinion, to realize intelligent systems with human like reasoning ability, we need to exploit knowledge from the brain science. Here we discuss a few findings in brain science that may help designing intelligent systems. We explain the relevance of transparency, explainability, learning from a few examples, and the trustworthiness of an AI system. We also discuss a few ways that may help to achieve these attributes in a learning system.
first_indexed 2024-12-10T20:53:18Z
format Article
id doaj.art-8f5f6da78300409f9ecfd597e50cee48
institution Directory Open Access Journal
issn 2296-9144
language English
last_indexed 2024-12-10T20:53:18Z
publishDate 2020-06-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Robotics and AI
spelling doaj.art-8f5f6da78300409f9ecfd597e50cee482022-12-22T01:34:02ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442020-06-01710.3389/frobt.2020.00076439984In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning CapabilitiesNikhil R. PalAt present we are witnessing a tremendous interest in Artificial Intelligence (AI), particularly in Deep Learning (DL)/Deep Neural Networks (DNNs). One of the reasons appears to be the unmatched performance achieved by such systems. This has resulted in an enormous hope on such techniques and often these are viewed as all—cure solutions. But most of these systems cannot explain why a particular decision is made (black box) and sometimes miserably fail in cases where other systems would not. Consequently, in critical applications such as healthcare and defense practitioners do not like to trust such systems. Although an AI system is often designed taking inspiration from the brain, there is not much attempt to exploit cues from the brain in true sense. In our opinion, to realize intelligent systems with human like reasoning ability, we need to exploit knowledge from the brain science. Here we discuss a few findings in brain science that may help designing intelligent systems. We explain the relevance of transparency, explainability, learning from a few examples, and the trustworthiness of an AI system. We also discuss a few ways that may help to achieve these attributes in a learning system.https://www.frontiersin.org/article/10.3389/frobt.2020.00076/fullArtificial IntelligenceDeep Neural Networksexplainable AItrustworthy AImachine learningsustainable AI
spellingShingle Nikhil R. Pal
In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning Capabilities
Frontiers in Robotics and AI
Artificial Intelligence
Deep Neural Networks
explainable AI
trustworthy AI
machine learning
sustainable AI
title In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning Capabilities
title_full In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning Capabilities
title_fullStr In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning Capabilities
title_full_unstemmed In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning Capabilities
title_short In Search of Trustworthy and Transparent Intelligent Systems With Human-Like Cognitive and Reasoning Capabilities
title_sort in search of trustworthy and transparent intelligent systems with human like cognitive and reasoning capabilities
topic Artificial Intelligence
Deep Neural Networks
explainable AI
trustworthy AI
machine learning
sustainable AI
url https://www.frontiersin.org/article/10.3389/frobt.2020.00076/full
work_keys_str_mv AT nikhilrpal insearchoftrustworthyandtransparentintelligentsystemswithhumanlikecognitiveandreasoningcapabilities