Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-Parameterization
In recent times, remote sensing image super-resolution reconstruction technology based on deep learning has experienced rapid development. However, most algorithms in this domain concentrate solely on enhancing the super-resolution network’s performance while neglecting the equally crucial aspect of...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-01-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/14/2/917 |
| _version_ | 1797340111583576064 |
|---|---|
| author | Jiaming Bian Ye Liu Jun Chen |
| author_facet | Jiaming Bian Ye Liu Jun Chen |
| author_sort | Jiaming Bian |
| collection | DOAJ |
| description | In recent times, remote sensing image super-resolution reconstruction technology based on deep learning has experienced rapid development. However, most algorithms in this domain concentrate solely on enhancing the super-resolution network’s performance while neglecting the equally crucial aspect of inference speed. In this study, we propose a method for lightweight super-resolution reconstruction of remote sensing images, termed SRRepViT. This approach reduces model parameters and floating-point operations during inference through parameter equivalent transformation. Using the RSSOD remote sensing dataset as our benchmark dataset, we compared the reconstruction performance, inference time, and model size of SRRepViT with other classical methods. Compared to the lightweight model ECBSR, SRRepViT exhibits slightly improved reconstruction performance while reducing inference time by 16% and model parameters by 34%, respectively. Moreover, compared to other classical super-resolution reconstruction methods, the SRRepViT model achieves similar reconstruction performance while reducing model parameters by 98% and increasing inference speed by 90% for a single remote sensing image. |
| first_indexed | 2024-03-08T09:58:15Z |
| format | Article |
| id | doaj.art-dfd02d4aa78745fb8b626edefb8e1526 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-08T09:58:15Z |
| publishDate | 2024-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-dfd02d4aa78745fb8b626edefb8e15262024-01-29T13:45:56ZengMDPI AGApplied Sciences2076-34172024-01-0114291710.3390/app14020917Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-ParameterizationJiaming Bian0Ye Liu1Jun Chen2School of Transportation Science and Engineering, Beihang University, Beijing 102206, ChinaSchool of Transportation Science and Engineering, Beihang University, Beijing 102206, ChinaSchool of Transportation Science and Engineering, Beihang University, Beijing 102206, ChinaIn recent times, remote sensing image super-resolution reconstruction technology based on deep learning has experienced rapid development. However, most algorithms in this domain concentrate solely on enhancing the super-resolution network’s performance while neglecting the equally crucial aspect of inference speed. In this study, we propose a method for lightweight super-resolution reconstruction of remote sensing images, termed SRRepViT. This approach reduces model parameters and floating-point operations during inference through parameter equivalent transformation. Using the RSSOD remote sensing dataset as our benchmark dataset, we compared the reconstruction performance, inference time, and model size of SRRepViT with other classical methods. Compared to the lightweight model ECBSR, SRRepViT exhibits slightly improved reconstruction performance while reducing inference time by 16% and model parameters by 34%, respectively. Moreover, compared to other classical super-resolution reconstruction methods, the SRRepViT model achieves similar reconstruction performance while reducing model parameters by 98% and increasing inference speed by 90% for a single remote sensing image.https://www.mdpi.com/2076-3417/14/2/917remote sensing imagesuper resolution reconstructionvision transformersstructural re-parameterization |
| spellingShingle | Jiaming Bian Ye Liu Jun Chen Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-Parameterization Applied Sciences remote sensing image super resolution reconstruction vision transformers structural re-parameterization |
| title | Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-Parameterization |
| title_full | Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-Parameterization |
| title_fullStr | Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-Parameterization |
| title_full_unstemmed | Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-Parameterization |
| title_short | Lightweight Super-Resolution Reconstruction Vision Transformers of Remote Sensing Image Based on Structural Re-Parameterization |
| title_sort | lightweight super resolution reconstruction vision transformers of remote sensing image based on structural re parameterization |
| topic | remote sensing image super resolution reconstruction vision transformers structural re-parameterization |
| url | https://www.mdpi.com/2076-3417/14/2/917 |
| work_keys_str_mv | AT jiamingbian lightweightsuperresolutionreconstructionvisiontransformersofremotesensingimagebasedonstructuralreparameterization AT yeliu lightweightsuperresolutionreconstructionvisiontransformersofremotesensingimagebasedonstructuralreparameterization AT junchen lightweightsuperresolutionreconstructionvisiontransformersofremotesensingimagebasedonstructuralreparameterization |