Adaptive weights learning in CNN feature fusion for crime scene investigation image classification

The combination of features from the convolutional layer and the fully connected layer of a convolutional neural network (CNN) provides an effective way to improve the performance of crime scene investigation (CSI) image classification. However, in existing work, as the weights in feature fusion do...

Full description

Bibliographic Details
Main Authors: Liu Ying, Zhang Qian Nan, Wang Fu Ping, Chiew Tuan Kiang, Lim Keng Pang, Zhang Heng Chang, Chao Lu, Lu Guo Jun, Ling Nam
Format: Article
Language:English
Published: Taylor & Francis Group 2021-07-01
Series:Connection Science
Subjects:
Online Access:http://dx.doi.org/10.1080/09540091.2021.1875987
Description
Summary:The combination of features from the convolutional layer and the fully connected layer of a convolutional neural network (CNN) provides an effective way to improve the performance of crime scene investigation (CSI) image classification. However, in existing work, as the weights in feature fusion do not change after the training phase, it may produce inaccurate image features which affect classification results. To solve this problem, this paper proposes an adaptive feature fusion method based on an auto-encoder to improve classification accuracy. The method includes the following steps: Firstly, the CNN model is trained by transfer learning. Next, the features of the convolution layer and the fully connected layer are extracted respectively. These extracted features are then passed into the auto-encoder for further learning with Softmax normalisation to obtain the adaptive weights for performing final classification. Experiments demonstrated that the proposed method achieves higher CSI image classification performance compared with fix weights feature fusion.
ISSN:0954-0091
1360-0494