MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement
Underwater imagery is plagued by issues such as image blurring and color distortion, which significantly impede the detection and operational capabilities of underwater robots, specifically Autonomous Underwater Vehicles (AUVs). Previous approaches to image fusion or multi-scale feature fusion based...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/2/529 |
| _version_ | 1797340215778476032 |
|---|---|
| author | Tianchi Zhang Yuxuan Liu |
| author_facet | Tianchi Zhang Yuxuan Liu |
| author_sort | Tianchi Zhang |
| collection | DOAJ |
| description | Underwater imagery is plagued by issues such as image blurring and color distortion, which significantly impede the detection and operational capabilities of underwater robots, specifically Autonomous Underwater Vehicles (AUVs). Previous approaches to image fusion or multi-scale feature fusion based on deep learning necessitated multi-branch image preprocessing prior to merging through fusion modules. However, these methods have intricate network structures and a high demand for computational resources, rendering them unsuitable for deployment on AUVs, which have limited resources at their disposal. To tackle these challenges, we propose a multi-teacher knowledge distillation GAN for underwater image enhancement (MTUW-GAN). Our approach entails multiple teacher networks instructing student networks simultaneously, enabling them to enhance color and detail in degraded images from various perspectives, thus achieving an image-fusion-level performance. Additionally, we employ middle layer channel distillation in conjunction with the attention mechanism to extract and transfer rich middle layer feature information from the teacher model to the student model. By eliminating multiplexed branching and fusion modules, our lightweight student model can directly generate enhanced underwater images through model compression. Furthermore, we introduce a multimodal objective enhancement function to refine the overall framework training, striking a balance between a low computational effort and high-quality image enhancement. Experimental results, obtained by comparing our method with existing approaches, demonstrate the clear advantages of our proposed method in terms of visual quality, model parameters, and real-time performance. Consequently, our method serves as an effective solution for real-time underwater image enhancement, specifically tailored for deployment on AUVs. |
| first_indexed | 2024-03-08T09:58:43Z |
| format | Article |
| id | doaj.art-60171f0c8a7e4f71ab5926b3e719b7df |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-08T09:58:43Z |
| publishDate | 2024-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-60171f0c8a7e4f71ab5926b3e719b7df2024-01-29T13:42:29ZengMDPI AGApplied Sciences2076-34172024-01-0114252910.3390/app14020529MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image EnhancementTianchi Zhang0Yuxuan Liu1School of Information Science and Engineering, Chongqing Jiaotong University, Chongqing 400074, ChinaSchool of Information Science and Engineering, Chongqing Jiaotong University, Chongqing 400074, ChinaUnderwater imagery is plagued by issues such as image blurring and color distortion, which significantly impede the detection and operational capabilities of underwater robots, specifically Autonomous Underwater Vehicles (AUVs). Previous approaches to image fusion or multi-scale feature fusion based on deep learning necessitated multi-branch image preprocessing prior to merging through fusion modules. However, these methods have intricate network structures and a high demand for computational resources, rendering them unsuitable for deployment on AUVs, which have limited resources at their disposal. To tackle these challenges, we propose a multi-teacher knowledge distillation GAN for underwater image enhancement (MTUW-GAN). Our approach entails multiple teacher networks instructing student networks simultaneously, enabling them to enhance color and detail in degraded images from various perspectives, thus achieving an image-fusion-level performance. Additionally, we employ middle layer channel distillation in conjunction with the attention mechanism to extract and transfer rich middle layer feature information from the teacher model to the student model. By eliminating multiplexed branching and fusion modules, our lightweight student model can directly generate enhanced underwater images through model compression. Furthermore, we introduce a multimodal objective enhancement function to refine the overall framework training, striking a balance between a low computational effort and high-quality image enhancement. Experimental results, obtained by comparing our method with existing approaches, demonstrate the clear advantages of our proposed method in terms of visual quality, model parameters, and real-time performance. Consequently, our method serves as an effective solution for real-time underwater image enhancement, specifically tailored for deployment on AUVs.https://www.mdpi.com/2076-3417/14/2/529underwater image enhancementimage fusionmulti-teacher knowledge distillationchannel distillation |
| spellingShingle | Tianchi Zhang Yuxuan Liu MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement Applied Sciences underwater image enhancement image fusion multi-teacher knowledge distillation channel distillation |
| title | MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement |
| title_full | MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement |
| title_fullStr | MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement |
| title_full_unstemmed | MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement |
| title_short | MTUW-GAN: A Multi-Teacher Knowledge Distillation Generative Adversarial Network for Underwater Image Enhancement |
| title_sort | mtuw gan a multi teacher knowledge distillation generative adversarial network for underwater image enhancement |
| topic | underwater image enhancement image fusion multi-teacher knowledge distillation channel distillation |
| url | https://www.mdpi.com/2076-3417/14/2/529 |
| work_keys_str_mv | AT tianchizhang mtuwganamultiteacherknowledgedistillationgenerativeadversarialnetworkforunderwaterimageenhancement AT yuxuanliu mtuwganamultiteacherknowledgedistillationgenerativeadversarialnetworkforunderwaterimageenhancement |