Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input

In recent years, numerous studies have been undertaken regarding person re-identification (ReID), an important issue for intelligent surveillance systems. Person ReID, however, is an extremely difficult problem because of variables such as different viewpoints and poses, and varying lighting in pers...

Full description

Bibliographic Details
Main Authors: Jin Kyu Kang, Toan Minh Hoang, Kang Ryoung Park
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8705321/
_version_ 1818728103634010112
author Jin Kyu Kang
Toan Minh Hoang
Kang Ryoung Park
author_facet Jin Kyu Kang
Toan Minh Hoang
Kang Ryoung Park
author_sort Jin Kyu Kang
collection DOAJ
description In recent years, numerous studies have been undertaken regarding person re-identification (ReID), an important issue for intelligent surveillance systems. Person ReID, however, is an extremely difficult problem because of variables such as different viewpoints and poses, and varying lighting in person regions in images that have been captured from remote distances. A majority of the studies have been performed for visible-light camera-based person ReID, which can be used only in a limited environment owing to the characteristics of a visible-light camera that are considerably dependent on the illumination. To overcome this problem, studies have been conducted for multimodal camera-based person ReID. However, because the previous studies used two or more input images, the computational complexity was high. This paper proposes a novel person ReID method that simplifies the convolutional neural network (CNN) structure by combining visible-light and thermal images as a single input. This method overcomes the limitation of visible-light camera-based person ReID using both a visible-light and thermal camera. To verify the performance of the proposed method, two open databases, the DBPerson-Recog-DB1, and Sun Yat-sen University multiple modality Re-ID (SYSU-MM01) databases were used. The method proposed in this study demonstrated excellent performance compared to the conventional methods.
first_indexed 2024-12-17T22:24:40Z
format Article
id doaj.art-aa1357ec06f14d7fa1cc56da901a41fd
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-17T22:24:40Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-aa1357ec06f14d7fa1cc56da901a41fd2022-12-21T21:30:23ZengIEEEIEEE Access2169-35362019-01-017579725798410.1109/ACCESS.2019.29146708705321Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single InputJin Kyu Kang0Toan Minh Hoang1Kang Ryoung Park2https://orcid.org/0000-0002-1214-9510Division of Electronics and Electrical Engineering, Dongguk University, Seoul, South KoreaDivision of Electronics and Electrical Engineering, Dongguk University, Seoul, South KoreaDivision of Electronics and Electrical Engineering, Dongguk University, Seoul, South KoreaIn recent years, numerous studies have been undertaken regarding person re-identification (ReID), an important issue for intelligent surveillance systems. Person ReID, however, is an extremely difficult problem because of variables such as different viewpoints and poses, and varying lighting in person regions in images that have been captured from remote distances. A majority of the studies have been performed for visible-light camera-based person ReID, which can be used only in a limited environment owing to the characteristics of a visible-light camera that are considerably dependent on the illumination. To overcome this problem, studies have been conducted for multimodal camera-based person ReID. However, because the previous studies used two or more input images, the computational complexity was high. This paper proposes a novel person ReID method that simplifies the convolutional neural network (CNN) structure by combining visible-light and thermal images as a single input. This method overcomes the limitation of visible-light camera-based person ReID using both a visible-light and thermal camera. To verify the performance of the proposed method, two open databases, the DBPerson-Recog-DB1, and Sun Yat-sen University multiple modality Re-ID (SYSU-MM01) databases were used. The method proposed in this study demonstrated excellent performance compared to the conventional methods.https://ieeexplore.ieee.org/document/8705321/Person re-identification (ReID)CNNmultimodal camera (RGB-IR)
spellingShingle Jin Kyu Kang
Toan Minh Hoang
Kang Ryoung Park
Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input
IEEE Access
Person re-identification (ReID)
CNN
multimodal camera (RGB-IR)
title Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input
title_full Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input
title_fullStr Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input
title_full_unstemmed Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input
title_short Person Re-Identification Between Visible and Thermal Camera Images Based on Deep Residual CNN Using Single Input
title_sort person re identification between visible and thermal camera images based on deep residual cnn using single input
topic Person re-identification (ReID)
CNN
multimodal camera (RGB-IR)
url https://ieeexplore.ieee.org/document/8705321/
work_keys_str_mv AT jinkyukang personreidentificationbetweenvisibleandthermalcameraimagesbasedondeepresidualcnnusingsingleinput
AT toanminhhoang personreidentificationbetweenvisibleandthermalcameraimagesbasedondeepresidualcnnusingsingleinput
AT kangryoungpark personreidentificationbetweenvisibleandthermalcameraimagesbasedondeepresidualcnnusingsingleinput