Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis
Land cover semantic segmentation in remote sensing image analysis is essential for various applications. However, the success of deep learning models like convolutional neural networks (CNN) relies on large-scale datasets, which can be challenging to acquire. This project investigates the gene...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2023
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/165982 |
| _version_ | 1811682584027987968 |
|---|---|
| author | Seah, Lyndon |
| author2 | Ke Yiping, Kelly |
| author_facet | Ke Yiping, Kelly Seah, Lyndon |
| author_sort | Seah, Lyndon |
| collection | NTU |
| description | Land cover semantic segmentation in remote sensing image analysis is essential for
various applications. However, the success of deep learning models like convolutional
neural networks (CNN) relies on large-scale datasets, which can be challenging to
acquire. This project investigates the generalizability of graph convolutional networks
(GCNs) when trained on limited datasets for land cover semantic segmentation tasks.
To address the problem of limited data, a combination of a pre-trained CNN (ResNet50)
and a GCN architecture is implemented, adopting a semi-supervised learning, where
only a subset of nodes has ground truth labels. The feature extraction is performed by
ResNet50, and the GCN architecture motivated by Thomas Kipf and Max Welling
processes the extracted features. The graph construction is based on adjacency matrix
and proximity-based relationships between nodes.
During the implementation phase, several challenges were faced, including a persistent
error during the training phase, which required a workaround involving interrupting
the training process. This led to the evaluation of the model using the half-trained state.
The results show a relationship between the training duration and the quality of the
predicted masks and mean intersection over union (mIoU) scores, indicating that the
semi-supervised method may have contributed to the observed outcome.
In conclusion, this project demonstrates the potential of combining pre-trained CNNs
and GCNs for land cover semantic segmentation with limited datasets. However, the
implementation faced challenges due to memory constraints, highlighting the
importance of good data structure knowledge and well-coded programs. Future work
can explore transfer learning and experimenting with the subset of nodes chosen to
improve generalizability. |
| first_indexed | 2024-10-01T03:59:09Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/165982 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T03:59:09Z |
| publishDate | 2023 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1659822023-04-21T15:37:56Z Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis Seah, Lyndon Ke Yiping, Kelly School of Computer Science and Engineering ypke@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Land cover semantic segmentation in remote sensing image analysis is essential for various applications. However, the success of deep learning models like convolutional neural networks (CNN) relies on large-scale datasets, which can be challenging to acquire. This project investigates the generalizability of graph convolutional networks (GCNs) when trained on limited datasets for land cover semantic segmentation tasks. To address the problem of limited data, a combination of a pre-trained CNN (ResNet50) and a GCN architecture is implemented, adopting a semi-supervised learning, where only a subset of nodes has ground truth labels. The feature extraction is performed by ResNet50, and the GCN architecture motivated by Thomas Kipf and Max Welling processes the extracted features. The graph construction is based on adjacency matrix and proximity-based relationships between nodes. During the implementation phase, several challenges were faced, including a persistent error during the training phase, which required a workaround involving interrupting the training process. This led to the evaluation of the model using the half-trained state. The results show a relationship between the training duration and the quality of the predicted masks and mean intersection over union (mIoU) scores, indicating that the semi-supervised method may have contributed to the observed outcome. In conclusion, this project demonstrates the potential of combining pre-trained CNNs and GCNs for land cover semantic segmentation with limited datasets. However, the implementation faced challenges due to memory constraints, highlighting the importance of good data structure knowledge and well-coded programs. Future work can explore transfer learning and experimenting with the subset of nodes chosen to improve generalizability. Bachelor of Engineering (Computer Science) 2023-04-18T03:03:46Z 2023-04-18T03:03:46Z 2023 Final Year Project (FYP) Seah, L. (2023). Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/165982 https://hdl.handle.net/10356/165982 en application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Seah, Lyndon Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis |
| title | Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis |
| title_full | Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis |
| title_fullStr | Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis |
| title_full_unstemmed | Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis |
| title_short | Graph-based model on limited dataset: land cover semantic segmentation in remote sensing image analysis |
| title_sort | graph based model on limited dataset land cover semantic segmentation in remote sensing image analysis |
| topic | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision |
| url | https://hdl.handle.net/10356/165982 |
| work_keys_str_mv | AT seahlyndon graphbasedmodelonlimiteddatasetlandcoversemanticsegmentationinremotesensingimageanalysis |