Optical-to-SAR image translation In remote sensing via generative adversarial network

With the remote sensing technology makes great progress, more and more remote sensing applications are used to satisfy rising needs. Satellite images have been widely applied for various fields, such as urban planning, geological exploration, and military object detection. In remote sensing technolo...

Full description

Bibliographic Details
Main Author: Li, Jiahua
Other Authors: Wen Bihan
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/158390
_version_ 1811688311194910720
author Li, Jiahua
author2 Wen Bihan
author_facet Wen Bihan
Li, Jiahua
author_sort Li, Jiahua
collection NTU
description With the remote sensing technology makes great progress, more and more remote sensing applications are used to satisfy rising needs. Satellite images have been widely applied for various fields, such as urban planning, geological exploration, and military object detection. In remote sensing technology, Synthetic aperture radar (SAR) are one of the most widely used imaging device. Compared with optical imaging technology, it is harder to acquire numerous SAR images due to its high cost in remote satellite. Consequently, the data annotation of EO-SAR dataset may be partially available. In addition, the lack of paired data severely limits the development of AI in remote sensing. In this project, Artificial Intelligent (AI) technology was used for image generation. Generative Adversarial Network (GAN), one of the most widely used network in AI, were explored for image translation which is from optical to SAR. This research attempted to use two GAN networks, CycleGAN and Pix2Pix, for realizing the image generation. Finally, the feasibility and performance of the two proposed network was confirmed in this project on a dataset including optical images and corresponding SAR images. By translating optical images into SAR images, this article aimed to solve the problem of lacking paired datasets in remote sensing field with different modalities. More efficient data enhancement methods can be used for many large-scale AI applications in remote sensing from this research. In future research, multi-modality fusion translation can be utilized by Lidar images, optical images and SAR images. With more features from different modalities, images translation can be more accurate.
first_indexed 2024-10-01T05:30:11Z
format Final Year Project (FYP)
id ntu-10356/158390
institution Nanyang Technological University
language English
last_indexed 2024-10-01T05:30:11Z
publishDate 2022
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1583902023-07-07T19:25:48Z Optical-to-SAR image translation In remote sensing via generative adversarial network Li, Jiahua Wen Bihan School of Electrical and Electronic Engineering bihan.wen@ntu.edu.sg Engineering::Electrical and electronic engineering With the remote sensing technology makes great progress, more and more remote sensing applications are used to satisfy rising needs. Satellite images have been widely applied for various fields, such as urban planning, geological exploration, and military object detection. In remote sensing technology, Synthetic aperture radar (SAR) are one of the most widely used imaging device. Compared with optical imaging technology, it is harder to acquire numerous SAR images due to its high cost in remote satellite. Consequently, the data annotation of EO-SAR dataset may be partially available. In addition, the lack of paired data severely limits the development of AI in remote sensing. In this project, Artificial Intelligent (AI) technology was used for image generation. Generative Adversarial Network (GAN), one of the most widely used network in AI, were explored for image translation which is from optical to SAR. This research attempted to use two GAN networks, CycleGAN and Pix2Pix, for realizing the image generation. Finally, the feasibility and performance of the two proposed network was confirmed in this project on a dataset including optical images and corresponding SAR images. By translating optical images into SAR images, this article aimed to solve the problem of lacking paired datasets in remote sensing field with different modalities. More efficient data enhancement methods can be used for many large-scale AI applications in remote sensing from this research. In future research, multi-modality fusion translation can be utilized by Lidar images, optical images and SAR images. With more features from different modalities, images translation can be more accurate. Bachelor of Engineering (Electrical and Electronic Engineering) 2022-06-03T02:43:07Z 2022-06-03T02:43:07Z 2022 Final Year Project (FYP) Li, J. (2022). Optical-to-SAR image translation In remote sensing via generative adversarial network. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/158390 https://hdl.handle.net/10356/158390 en application/pdf Nanyang Technological University
spellingShingle Engineering::Electrical and electronic engineering
Li, Jiahua
Optical-to-SAR image translation In remote sensing via generative adversarial network
title Optical-to-SAR image translation In remote sensing via generative adversarial network
title_full Optical-to-SAR image translation In remote sensing via generative adversarial network
title_fullStr Optical-to-SAR image translation In remote sensing via generative adversarial network
title_full_unstemmed Optical-to-SAR image translation In remote sensing via generative adversarial network
title_short Optical-to-SAR image translation In remote sensing via generative adversarial network
title_sort optical to sar image translation in remote sensing via generative adversarial network
topic Engineering::Electrical and electronic engineering
url https://hdl.handle.net/10356/158390
work_keys_str_mv AT lijiahua opticaltosarimagetranslationinremotesensingviagenerativeadversarialnetwork