Deep learning based methods for low-resolution person re-identification
Person re-identification (re-id) is a fundamental task in automated surveillance. In practice, surveillance is often performed using multiple camera views to expand surveillance range. Hence the resolution of person images captured under these different camera views varies drastically due to the unc...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2021
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/147938 |
| _version_ | 1826112080439148544 |
|---|---|
| author | Sebastian, Jason |
| author2 | Lin Weisi |
| author_facet | Lin Weisi Sebastian, Jason |
| author_sort | Sebastian, Jason |
| collection | NTU |
| description | Person re-identification (re-id) is a fundamental task in automated surveillance. In practice, surveillance is often performed using multiple camera views to expand surveillance range. Hence the resolution of person images captured under these different camera views varies drastically due to the unconstrained distance between persons and cameras. We call this setting low-resolution person re-identification (LR re-id). In LR re-id, query images are often of low-resolution (LR) and gallery images are often of high-resolution (HR). This causes the resolution mismatch problem, which needs to be addressed because LR query images lack appearance details which are needed for re-id. It is a non-trivial problem because simply resizing the query image does not recover appearance details. Recently, HRNet was introduced as a deep learning framework to tackle position-sensitive tasks which require high-resolution representations. HRNet has shown state-of-the-art results in semantic segmentation, object detection, etc. Although the possibility of implementing HRNet for applications in the LR re-id setting looks promising, to the best of our knowledge there has yet to be an attempt to apply HRNet for LR re-id. Moreover, with advancements in super-resolution (SR) research, it is possible to recover appearance details from LR images which are needed to solve the resolution mismatch problem. This project attempts to develop an effective deep learning framework to cope with the LR re-id problem. This consists of three parts. Firstly, use HRNet as a feature extraction module for re-id. Secondly, use an existing deep learning based SR module to enhance appearance details of a given query image. Thirdly, jointly learn SR and re-id modules so that the appearance details generated by the SR module are useful for the re-id feature extraction task. This project successfully demonstrates that it is possible to address the resolution mismatch problem by using HRNet as a backbone and by jointly learning SR and re-id. |
| first_indexed | 2024-10-01T03:01:26Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/147938 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T03:01:26Z |
| publishDate | 2021 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1479382021-04-16T07:41:26Z Deep learning based methods for low-resolution person re-identification Sebastian, Jason Lin Weisi School of Computer Science and Engineering Zhang Guoqing WSLin@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Person re-identification (re-id) is a fundamental task in automated surveillance. In practice, surveillance is often performed using multiple camera views to expand surveillance range. Hence the resolution of person images captured under these different camera views varies drastically due to the unconstrained distance between persons and cameras. We call this setting low-resolution person re-identification (LR re-id). In LR re-id, query images are often of low-resolution (LR) and gallery images are often of high-resolution (HR). This causes the resolution mismatch problem, which needs to be addressed because LR query images lack appearance details which are needed for re-id. It is a non-trivial problem because simply resizing the query image does not recover appearance details. Recently, HRNet was introduced as a deep learning framework to tackle position-sensitive tasks which require high-resolution representations. HRNet has shown state-of-the-art results in semantic segmentation, object detection, etc. Although the possibility of implementing HRNet for applications in the LR re-id setting looks promising, to the best of our knowledge there has yet to be an attempt to apply HRNet for LR re-id. Moreover, with advancements in super-resolution (SR) research, it is possible to recover appearance details from LR images which are needed to solve the resolution mismatch problem. This project attempts to develop an effective deep learning framework to cope with the LR re-id problem. This consists of three parts. Firstly, use HRNet as a feature extraction module for re-id. Secondly, use an existing deep learning based SR module to enhance appearance details of a given query image. Thirdly, jointly learn SR and re-id modules so that the appearance details generated by the SR module are useful for the re-id feature extraction task. This project successfully demonstrates that it is possible to address the resolution mismatch problem by using HRNet as a backbone and by jointly learning SR and re-id. Bachelor of Engineering (Computer Science) 2021-04-16T07:41:25Z 2021-04-16T07:41:25Z 2021 Final Year Project (FYP) Sebastian, J. (2021). Deep learning based methods for low-resolution person re-identification. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/147938 https://hdl.handle.net/10356/147938 en SCSE20-0178 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Sebastian, Jason Deep learning based methods for low-resolution person re-identification |
| title | Deep learning based methods for low-resolution person re-identification |
| title_full | Deep learning based methods for low-resolution person re-identification |
| title_fullStr | Deep learning based methods for low-resolution person re-identification |
| title_full_unstemmed | Deep learning based methods for low-resolution person re-identification |
| title_short | Deep learning based methods for low-resolution person re-identification |
| title_sort | deep learning based methods for low resolution person re identification |
| topic | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision |
| url | https://hdl.handle.net/10356/147938 |
| work_keys_str_mv | AT sebastianjason deeplearningbasedmethodsforlowresolutionpersonreidentification |