Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared Image
Complex illumination, solar flares and heavy smog on the sea surface have caused difficulties to accurately obtain high-quality imaging and multi-dimensional information of marine monitoring targets, such as oil spill, red tide and underwater vehicle wake. The principle of existing imaging mechanism...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-10-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/12/21/10871 |
| _version_ | 1797469300175405056 |
|---|---|
| author | Zhipeng Ren Jianping Zhao Chao Wang Xiaocong Ma Yan Lou Peng Wang |
| author_facet | Zhipeng Ren Jianping Zhao Chao Wang Xiaocong Ma Yan Lou Peng Wang |
| author_sort | Zhipeng Ren |
| collection | DOAJ |
| description | Complex illumination, solar flares and heavy smog on the sea surface have caused difficulties to accurately obtain high-quality imaging and multi-dimensional information of marine monitoring targets, such as oil spill, red tide and underwater vehicle wake. The principle of existing imaging mechanism is complex, and thus it is not practical to capture high-resolution infrared images efficiently. To combat this challenge by utilizing new infrared optical materials and single point diamond-turning technology, we designed and processed a simple, light and strong condensing ability medium and long wavelength infrared imaging optical system with large relative aperture, which can obtain high-quality infrared images. On top of this, with the training from a combination of infrared and visible light images, we also proposed a super-resolution network model, which is composed of a feature extraction layer, an information extraction block and a reconstruction block. The initial features of the input images are recognized in feature extraction layer. Next, to supply missing feature information and recover more details on infrared image extracted from a dense connection block, a feature mapping attention mechanism is introduced. Its main function is to transfer the important feature information of the visible light images in the information extraction block. Finally, the global feature information is integrated in the reconstruction block to reconstruct the high-resolution infrared image. We experimented our algorithm on both of the public Kaist datasets and self-collected datasets, and then compared it with several relevant algorithms. The results showed that our algorithm can significantly improve the reconstruction performance and reveal more detail information, and enhance the visual effect. Therefore, it brings excellent potential in dealing with the problem of low resolution of optical infrared imaging in complex marine environment. |
| first_indexed | 2024-03-09T19:18:30Z |
| format | Article |
| id | doaj.art-cc93c7b5fae7441cbb33bcac26b49552 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-09T19:18:30Z |
| publishDate | 2022-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-cc93c7b5fae7441cbb33bcac26b495522023-11-24T03:34:12ZengMDPI AGApplied Sciences2076-34172022-10-0112211087110.3390/app122110871Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared ImageZhipeng Ren0Jianping Zhao1Chao Wang2Xiaocong Ma3Yan Lou4Peng Wang5School of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, ChinaSchool of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, ChinaInstitute of Space Optoelectronic Technology, Changchun University of Science and Technology, Changchun 130022, ChinaMuti-Media Communication Research Laboratory, University of Ottawa, Ottawa, ON K1N 6N5, CanadaInstitute of Space Optoelectronic Technology, Changchun University of Science and Technology, Changchun 130022, ChinaSchool of Computer Science and Technology, Changchun University of Science and Technology, Changchun 130022, ChinaComplex illumination, solar flares and heavy smog on the sea surface have caused difficulties to accurately obtain high-quality imaging and multi-dimensional information of marine monitoring targets, such as oil spill, red tide and underwater vehicle wake. The principle of existing imaging mechanism is complex, and thus it is not practical to capture high-resolution infrared images efficiently. To combat this challenge by utilizing new infrared optical materials and single point diamond-turning technology, we designed and processed a simple, light and strong condensing ability medium and long wavelength infrared imaging optical system with large relative aperture, which can obtain high-quality infrared images. On top of this, with the training from a combination of infrared and visible light images, we also proposed a super-resolution network model, which is composed of a feature extraction layer, an information extraction block and a reconstruction block. The initial features of the input images are recognized in feature extraction layer. Next, to supply missing feature information and recover more details on infrared image extracted from a dense connection block, a feature mapping attention mechanism is introduced. Its main function is to transfer the important feature information of the visible light images in the information extraction block. Finally, the global feature information is integrated in the reconstruction block to reconstruct the high-resolution infrared image. We experimented our algorithm on both of the public Kaist datasets and self-collected datasets, and then compared it with several relevant algorithms. The results showed that our algorithm can significantly improve the reconstruction performance and reveal more detail information, and enhance the visual effect. Therefore, it brings excellent potential in dealing with the problem of low resolution of optical infrared imaging in complex marine environment.https://www.mdpi.com/2076-3417/12/21/10871infrared imagingsuper-resolutionattention mechanismmarine monitoring |
| spellingShingle | Zhipeng Ren Jianping Zhao Chao Wang Xiaocong Ma Yan Lou Peng Wang Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared Image Applied Sciences infrared imaging super-resolution attention mechanism marine monitoring |
| title | Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared Image |
| title_full | Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared Image |
| title_fullStr | Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared Image |
| title_full_unstemmed | Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared Image |
| title_short | Research on Key Technologies of Super-Resolution Reconstruction of Medium and Long Wave Maritime Infrared Image |
| title_sort | research on key technologies of super resolution reconstruction of medium and long wave maritime infrared image |
| topic | infrared imaging super-resolution attention mechanism marine monitoring |
| url | https://www.mdpi.com/2076-3417/12/21/10871 |
| work_keys_str_mv | AT zhipengren researchonkeytechnologiesofsuperresolutionreconstructionofmediumandlongwavemaritimeinfraredimage AT jianpingzhao researchonkeytechnologiesofsuperresolutionreconstructionofmediumandlongwavemaritimeinfraredimage AT chaowang researchonkeytechnologiesofsuperresolutionreconstructionofmediumandlongwavemaritimeinfraredimage AT xiaocongma researchonkeytechnologiesofsuperresolutionreconstructionofmediumandlongwavemaritimeinfraredimage AT yanlou researchonkeytechnologiesofsuperresolutionreconstructionofmediumandlongwavemaritimeinfraredimage AT pengwang researchonkeytechnologiesofsuperresolutionreconstructionofmediumandlongwavemaritimeinfraredimage |