Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results
Deep neural networks (DNN) try to analyze given data, to come up with decisions regarding the inputs. The decision-making process of the DNN model is not entirely transparent. The confidence of the model predictions on new data fed into the network can vary. We address the question of certainty of d...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-03-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1099-4300/25/4/573 |
| _version_ | 1827745139119882240 |
|---|---|
| author | Elakkat D. Gireesh Varadaraj P. Gurupur |
| author_facet | Elakkat D. Gireesh Varadaraj P. Gurupur |
| author_sort | Elakkat D. Gireesh |
| collection | DOAJ |
| description | Deep neural networks (DNN) try to analyze given data, to come up with decisions regarding the inputs. The decision-making process of the DNN model is not entirely transparent. The confidence of the model predictions on new data fed into the network can vary. We address the question of certainty of decision making and adequacy of information capturing by DNN models during this process of decision-making. We introduce a measure called certainty index, which is based on the outputs in the most penultimate layer of DNN. In this approach, we employed iEEG (intracranial electroencephalogram) data to train and test DNN. When arriving at model predictions, the contribution of the entire information content of the input may be important. We explored the relationship between the certainty of DNN predictions and information content of the signal by estimating the sample entropy and using a heatmap of the signal. While it can be assumed that the entire sample must be utilized for arriving at the most appropriate decisions, an evaluation of DNNs from this standpoint has not been reported. We demonstrate that the robustness of the relationship between certainty index with the sample entropy, demonstrated through sample entropy-heatmap correlation, is higher than that with the original signal, indicating that the DNN focuses on information rich regions of the signal to arrive at decisions. Therefore, it can be concluded that the certainty of a decision is related to the DNN’s ability to capture the information in the original signal. Our results indicate that, within its limitations, the certainty index can be used as useful tool in estimating the confidence of predictions. The certainty index appears to be related to how effectively DNN heatmaps captured the information content in the signal. |
| first_indexed | 2024-03-11T05:02:54Z |
| format | Article |
| id | doaj.art-3813bcb81b4f4e07b293bc4c21491866 |
| institution | Directory Open Access Journal |
| issn | 1099-4300 |
| language | English |
| last_indexed | 2024-03-11T05:02:54Z |
| publishDate | 2023-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Entropy |
| spelling | doaj.art-3813bcb81b4f4e07b293bc4c214918662023-11-17T19:07:58ZengMDPI AGEntropy1099-43002023-03-0125457310.3390/e25040573Information Entropy Measures for Evaluation of Reliability of Deep Neural Network ResultsElakkat D. Gireesh0Varadaraj P. Gurupur1Department of Computer Engineering, University of Central Florida, Orlando, FL 32817, USADepartment of Computer Engineering, University of Central Florida, Orlando, FL 32817, USADeep neural networks (DNN) try to analyze given data, to come up with decisions regarding the inputs. The decision-making process of the DNN model is not entirely transparent. The confidence of the model predictions on new data fed into the network can vary. We address the question of certainty of decision making and adequacy of information capturing by DNN models during this process of decision-making. We introduce a measure called certainty index, which is based on the outputs in the most penultimate layer of DNN. In this approach, we employed iEEG (intracranial electroencephalogram) data to train and test DNN. When arriving at model predictions, the contribution of the entire information content of the input may be important. We explored the relationship between the certainty of DNN predictions and information content of the signal by estimating the sample entropy and using a heatmap of the signal. While it can be assumed that the entire sample must be utilized for arriving at the most appropriate decisions, an evaluation of DNNs from this standpoint has not been reported. We demonstrate that the robustness of the relationship between certainty index with the sample entropy, demonstrated through sample entropy-heatmap correlation, is higher than that with the original signal, indicating that the DNN focuses on information rich regions of the signal to arrive at decisions. Therefore, it can be concluded that the certainty of a decision is related to the DNN’s ability to capture the information in the original signal. Our results indicate that, within its limitations, the certainty index can be used as useful tool in estimating the confidence of predictions. The certainty index appears to be related to how effectively DNN heatmaps captured the information content in the signal.https://www.mdpi.com/1099-4300/25/4/573certaintyinformation entropyiEEG |
| spellingShingle | Elakkat D. Gireesh Varadaraj P. Gurupur Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results Entropy certainty information entropy iEEG |
| title | Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results |
| title_full | Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results |
| title_fullStr | Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results |
| title_full_unstemmed | Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results |
| title_short | Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results |
| title_sort | information entropy measures for evaluation of reliability of deep neural network results |
| topic | certainty information entropy iEEG |
| url | https://www.mdpi.com/1099-4300/25/4/573 |
| work_keys_str_mv | AT elakkatdgireesh informationentropymeasuresforevaluationofreliabilityofdeepneuralnetworkresults AT varadarajpgurupur informationentropymeasuresforevaluationofreliabilityofdeepneuralnetworkresults |