Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss
Out-of-distribution (OOD) detection is related to the security and stability of deep learning models deployed in the real world. The existing OOD detection algorithms based on the neural network normally use a single scoring function to detect out-of-distribution examples, which start from the poste...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9801848/ |
| _version_ | 1811309394128797696 |
|---|---|
| author | Qiuyu Zhu Guohui Zheng Jiakang Shen Rui Wang |
| author_facet | Qiuyu Zhu Guohui Zheng Jiakang Shen Rui Wang |
| author_sort | Qiuyu Zhu |
| collection | DOAJ |
| description | Out-of-distribution (OOD) detection is related to the security and stability of deep learning models deployed in the real world. The existing OOD detection algorithms based on the neural network normally use a single scoring function to detect out-of-distribution examples, which start from the posterior probability and do not fully utilize the information of the pre-trained model. In this paper, based on our previous PEDCC-based work, feature fusion is explored in OOD detection to take maximum advantage of the pre-trained classifier features. Our improved method adopts a two-stage training approach, in which multiple OOD detection features of the first-stage neural network classifier are extracted as the input of the second-stage training. In addition, we propose the stop-near-saturation method, which can help the OOD detection algorithm find optimal network parameters without accessing OOD data. Extensive experiments on several public datasets and classification networks show that compared with other existing methods, this method has better OOD detection performance, and maintains the low computational complexity of the original PEDCC-based method. |
| first_indexed | 2024-04-13T09:41:21Z |
| format | Article |
| id | doaj.art-d959b1839b9b4cada8be440000a39e86 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-13T09:41:21Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-d959b1839b9b4cada8be440000a39e862022-12-22T02:51:55ZengIEEEIEEE Access2169-35362022-01-0110661906619710.1109/ACCESS.2022.31846949801848Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-LossQiuyu Zhu0https://orcid.org/0000-0001-9514-9323Guohui Zheng1https://orcid.org/0000-0001-8114-1769Jiakang Shen2Rui Wang3https://orcid.org/0000-0002-7974-9510School of Communication and Information Engineering, Shanghai University, Shanghai, ChinaSchool of Communication and Information Engineering, Shanghai University, Shanghai, ChinaSchool of Communication and Information Engineering, Shanghai University, Shanghai, ChinaSchool of Communication and Information Engineering, Shanghai University, Shanghai, ChinaOut-of-distribution (OOD) detection is related to the security and stability of deep learning models deployed in the real world. The existing OOD detection algorithms based on the neural network normally use a single scoring function to detect out-of-distribution examples, which start from the posterior probability and do not fully utilize the information of the pre-trained model. In this paper, based on our previous PEDCC-based work, feature fusion is explored in OOD detection to take maximum advantage of the pre-trained classifier features. Our improved method adopts a two-stage training approach, in which multiple OOD detection features of the first-stage neural network classifier are extracted as the input of the second-stage training. In addition, we propose the stop-near-saturation method, which can help the OOD detection algorithm find optimal network parameters without accessing OOD data. Extensive experiments on several public datasets and classification networks show that compared with other existing methods, this method has better OOD detection performance, and maintains the low computational complexity of the original PEDCC-based method.https://ieeexplore.ieee.org/document/9801848/Feature fusionin-distributionneural networkout-of-distribution detection |
| spellingShingle | Qiuyu Zhu Guohui Zheng Jiakang Shen Rui Wang Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss IEEE Access Feature fusion in-distribution neural network out-of-distribution detection |
| title | Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss |
| title_full | Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss |
| title_fullStr | Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss |
| title_full_unstemmed | Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss |
| title_short | Out-of-Distribution Detection Based on Feature Fusion in Neural Network Classifier Pre-Trained by PEDCC-Loss |
| title_sort | out of distribution detection based on feature fusion in neural network classifier pre trained by pedcc loss |
| topic | Feature fusion in-distribution neural network out-of-distribution detection |
| url | https://ieeexplore.ieee.org/document/9801848/ |
| work_keys_str_mv | AT qiuyuzhu outofdistributiondetectionbasedonfeaturefusioninneuralnetworkclassifierpretrainedbypedccloss AT guohuizheng outofdistributiondetectionbasedonfeaturefusioninneuralnetworkclassifierpretrainedbypedccloss AT jiakangshen outofdistributiondetectionbasedonfeaturefusioninneuralnetworkclassifierpretrainedbypedccloss AT ruiwang outofdistributiondetectionbasedonfeaturefusioninneuralnetworkclassifierpretrainedbypedccloss |