Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval

Remote sensing image retrieval (RSIR) is the process of searching for identical areas by investigating the similarities between a query image and the database images. RSIR is a challenging task owing to the time difference, viewpoint, and coverage area depending on the shooting circumstance, resulti...

Full description

Bibliographic Details
Main Authors: Min-Sub Yun, Woo-Jeoung Nam, Seong-Whan Lee
Format: Article
Language:English
Published: MDPI AG 2020-01-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/12/2/219
_version_ 1828143535539355648
author Min-Sub Yun
Woo-Jeoung Nam
Seong-Whan Lee
author_facet Min-Sub Yun
Woo-Jeoung Nam
Seong-Whan Lee
author_sort Min-Sub Yun
collection DOAJ
description Remote sensing image retrieval (RSIR) is the process of searching for identical areas by investigating the similarities between a query image and the database images. RSIR is a challenging task owing to the time difference, viewpoint, and coverage area depending on the shooting circumstance, resulting in variations in the image contents. In this paper, we propose a novel method based on a coarse-to-fine strategy, which makes a deep network more robust to the variations in remote sensing images. Moreover, we propose a new triangular loss function to consider the whole relation within the tuple. This loss function improves the retrieval performance and demonstrates better performance in terms of learning the detailed information in complex remote sensing images. To verify our methods, we experimented with the Google Earth South Korea dataset, which contains 40,000 images, using the evaluation metric Recall@n. In all experiments, we obtained better performance results than those of the existing retrieval training methods. Our source code and Google Earth South Korea dataset are available online.
first_indexed 2024-04-11T19:58:48Z
format Article
id doaj.art-2595ee84cd9b474fb97d865ee949bb25
institution Directory Open Access Journal
issn 2072-4292
language English
last_indexed 2024-04-11T19:58:48Z
publishDate 2020-01-01
publisher MDPI AG
record_format Article
series Remote Sensing
spelling doaj.art-2595ee84cd9b474fb97d865ee949bb252022-12-22T04:05:42ZengMDPI AGRemote Sensing2072-42922020-01-0112221910.3390/rs12020219rs12020219Coarse-to-Fine Deep Metric Learning for Remote Sensing Image RetrievalMin-Sub Yun0Woo-Jeoung Nam1Seong-Whan Lee2Department of Brain and Cognitive Engineering, Korea University, Anam-dong, Seongbuk-gu, Seoul 02841, KoreaDepartment of Computer and Radio Communication Engineering, Korea University, Anam-dong, Seongbuk-gu, Seoul 02841, KoreaDepartment of Brain and Cognitive Engineering, Korea University, Anam-dong, Seongbuk-gu, Seoul 02841, KoreaRemote sensing image retrieval (RSIR) is the process of searching for identical areas by investigating the similarities between a query image and the database images. RSIR is a challenging task owing to the time difference, viewpoint, and coverage area depending on the shooting circumstance, resulting in variations in the image contents. In this paper, we propose a novel method based on a coarse-to-fine strategy, which makes a deep network more robust to the variations in remote sensing images. Moreover, we propose a new triangular loss function to consider the whole relation within the tuple. This loss function improves the retrieval performance and demonstrates better performance in terms of learning the detailed information in complex remote sensing images. To verify our methods, we experimented with the Google Earth South Korea dataset, which contains 40,000 images, using the evaluation metric Recall@n. In all experiments, we obtained better performance results than those of the existing retrieval training methods. Our source code and Google Earth South Korea dataset are available online.https://www.mdpi.com/2072-4292/12/2/219remote sensing image retrieval (rsir)deep metric learningconvolutional neural networkscontents based image retrieval (cbir)deep learning
spellingShingle Min-Sub Yun
Woo-Jeoung Nam
Seong-Whan Lee
Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval
Remote Sensing
remote sensing image retrieval (rsir)
deep metric learning
convolutional neural networks
contents based image retrieval (cbir)
deep learning
title Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval
title_full Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval
title_fullStr Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval
title_full_unstemmed Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval
title_short Coarse-to-Fine Deep Metric Learning for Remote Sensing Image Retrieval
title_sort coarse to fine deep metric learning for remote sensing image retrieval
topic remote sensing image retrieval (rsir)
deep metric learning
convolutional neural networks
contents based image retrieval (cbir)
deep learning
url https://www.mdpi.com/2072-4292/12/2/219
work_keys_str_mv AT minsubyun coarsetofinedeepmetriclearningforremotesensingimageretrieval
AT woojeoungnam coarsetofinedeepmetriclearningforremotesensingimageretrieval
AT seongwhanlee coarsetofinedeepmetriclearningforremotesensingimageretrieval