Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening
This paper presents a near real-time automatic sub-pixel registration method of high-resolution panchromatic (PAN) and multispectral (MS) images using a graphics processing unit (GPU). In the first step, the method uses differential geo-registration to enable accurate geographic registration of PAN...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-09-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/13/18/3674 |
| _version_ | 1797517323638145024 |
|---|---|
| author | Guangqi Xie Mi Wang Zhiqi Zhang Shao Xiang Luxiao He |
| author_facet | Guangqi Xie Mi Wang Zhiqi Zhang Shao Xiang Luxiao He |
| author_sort | Guangqi Xie |
| collection | DOAJ |
| description | This paper presents a near real-time automatic sub-pixel registration method of high-resolution panchromatic (PAN) and multispectral (MS) images using a graphics processing unit (GPU). In the first step, the method uses differential geo-registration to enable accurate geographic registration of PAN and MS images. Differential geo-registration normalizes PAN and MS images to the same direction and scale. There are also some residual misalignments due to the geometrical configuration of the acquisition instruments. These residual misalignments mean the PAN and MS images still have deviations after differential geo-registration. The second step is to use differential rectification with tiny facet primitive to eliminate possible residual misalignments. Differential rectification corrects the relative internal geometric distortion between PAN and MS images. The computational burden of these two steps is large, and traditional central processing unit (CPU) processing takes a long time. Due to the natural parallelism of the differential methods, these two steps are very suitable for mapping to a GPU for processing, to achieve near real-time processing while ensuring processing accuracy. This paper used GaoFen-6, GaoFen-7, ZiYuan3-02 and SuperView-1 satellite data to conduct an experiment. The experiment showed that our method’s processing accuracy is within 0.5 pixels. The automatic processing time of this method is about 2.5 s for 1 GB output data in the NVIDIA GeForce RTX 2080Ti, which can meet the near real-time processing requirements for most satellites. The method in this paper can quickly achieve high-precision registration of PAN and MS images. It is suitable for different scenes and different sensors. It is extremely robust to registration errors between PAN and MS. |
| first_indexed | 2024-03-10T07:15:04Z |
| format | Article |
| id | doaj.art-0f207fb1b20f4afeabd1d525f914b7fc |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-10T07:15:04Z |
| publishDate | 2021-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-0f207fb1b20f4afeabd1d525f914b7fc2023-11-22T15:06:38ZengMDPI AGRemote Sensing2072-42922021-09-011318367410.3390/rs13183674Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-SharpeningGuangqi Xie0Mi Wang1Zhiqi Zhang2Shao Xiang3Luxiao He4State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, ChinaState Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, ChinaThis paper presents a near real-time automatic sub-pixel registration method of high-resolution panchromatic (PAN) and multispectral (MS) images using a graphics processing unit (GPU). In the first step, the method uses differential geo-registration to enable accurate geographic registration of PAN and MS images. Differential geo-registration normalizes PAN and MS images to the same direction and scale. There are also some residual misalignments due to the geometrical configuration of the acquisition instruments. These residual misalignments mean the PAN and MS images still have deviations after differential geo-registration. The second step is to use differential rectification with tiny facet primitive to eliminate possible residual misalignments. Differential rectification corrects the relative internal geometric distortion between PAN and MS images. The computational burden of these two steps is large, and traditional central processing unit (CPU) processing takes a long time. Due to the natural parallelism of the differential methods, these two steps are very suitable for mapping to a GPU for processing, to achieve near real-time processing while ensuring processing accuracy. This paper used GaoFen-6, GaoFen-7, ZiYuan3-02 and SuperView-1 satellite data to conduct an experiment. The experiment showed that our method’s processing accuracy is within 0.5 pixels. The automatic processing time of this method is about 2.5 s for 1 GB output data in the NVIDIA GeForce RTX 2080Ti, which can meet the near real-time processing requirements for most satellites. The method in this paper can quickly achieve high-precision registration of PAN and MS images. It is suitable for different scenes and different sensors. It is extremely robust to registration errors between PAN and MS.https://www.mdpi.com/2072-4292/13/18/3674registrationpansharpeningnear real-timeautomatic |
| spellingShingle | Guangqi Xie Mi Wang Zhiqi Zhang Shao Xiang Luxiao He Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening Remote Sensing registration pansharpening near real-time automatic |
| title | Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening |
| title_full | Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening |
| title_fullStr | Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening |
| title_full_unstemmed | Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening |
| title_short | Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening |
| title_sort | near real time automatic sub pixel registration of panchromatic and multispectral images for pan sharpening |
| topic | registration pansharpening near real-time automatic |
| url | https://www.mdpi.com/2072-4292/13/18/3674 |
| work_keys_str_mv | AT guangqixie nearrealtimeautomaticsubpixelregistrationofpanchromaticandmultispectralimagesforpansharpening AT miwang nearrealtimeautomaticsubpixelregistrationofpanchromaticandmultispectralimagesforpansharpening AT zhiqizhang nearrealtimeautomaticsubpixelregistrationofpanchromaticandmultispectralimagesforpansharpening AT shaoxiang nearrealtimeautomaticsubpixelregistrationofpanchromaticandmultispectralimagesforpansharpening AT luxiaohe nearrealtimeautomaticsubpixelregistrationofpanchromaticandmultispectralimagesforpansharpening |