Rich Structural Index for Stereoscopic Image Quality Assessment
The human visual system (HVS), affected by viewing distance when perceiving the stereo image information, is of great significance to study of stereoscopic image quality assessment. Many methods of stereoscopic image quality assessment do not have comprehensive consideration for human visual percept...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-01-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/2/499 |
| _version_ | 1797490577333288960 |
|---|---|
| author | Hua Zhang Xinwen Hu Ruoyun Gou Lingjun Zhang Bolun Zheng Zhuonan Shen |
| author_facet | Hua Zhang Xinwen Hu Ruoyun Gou Lingjun Zhang Bolun Zheng Zhuonan Shen |
| author_sort | Hua Zhang |
| collection | DOAJ |
| description | The human visual system (HVS), affected by viewing distance when perceiving the stereo image information, is of great significance to study of stereoscopic image quality assessment. Many methods of stereoscopic image quality assessment do not have comprehensive consideration for human visual perception characteristics. In accordance with this, we propose a Rich Structural Index (RSI) for Stereoscopic Image objective Quality Assessment (SIQA) method based on multi-scale perception characteristics. To begin with, we put the stereo pair into the image pyramid based on Contrast Sensitivity Function (CSF) to obtain sensitive images of different resolution. Then, we obtain local Luminance and Structural Index (LSI) in a locally adaptive manner on gradient maps which consider the luminance masking and contrast masking. At the same time we use Singular Value Decomposition (SVD) to obtain the Sharpness and Intrinsic Structural Index (SISI) to effectively capture the changes introduced in the image (due to distortion). Meanwhile, considering the disparity edge structures, we use gradient cross-mapping algorithm to obtain Depth Texture Structural Index (DTSI). After that, we apply the standard deviation method for the above results to obtain contrast index of reference and distortion components. Finally, for the loss caused by the randomness of the parameters, we use Support Vector Machine Regression based on Genetic Algorithm (GA-SVR) training to obtain the final quality score. We conducted a comprehensive evaluation with state-of-the-art methods on four open databases. The experimental results show that the proposed method has stable performance and strong competitive advantage. |
| first_indexed | 2024-03-10T00:34:59Z |
| format | Article |
| id | doaj.art-fbc9ca3dc913445a8ec42864b49e7365 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T00:34:59Z |
| publishDate | 2022-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-fbc9ca3dc913445a8ec42864b49e73652023-11-23T15:19:41ZengMDPI AGSensors1424-82202022-01-0122249910.3390/s22020499Rich Structural Index for Stereoscopic Image Quality AssessmentHua Zhang0Xinwen Hu1Ruoyun Gou2Lingjun Zhang3Bolun Zheng4Zhuonan Shen5School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, ChinaSchool of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, ChinaThe human visual system (HVS), affected by viewing distance when perceiving the stereo image information, is of great significance to study of stereoscopic image quality assessment. Many methods of stereoscopic image quality assessment do not have comprehensive consideration for human visual perception characteristics. In accordance with this, we propose a Rich Structural Index (RSI) for Stereoscopic Image objective Quality Assessment (SIQA) method based on multi-scale perception characteristics. To begin with, we put the stereo pair into the image pyramid based on Contrast Sensitivity Function (CSF) to obtain sensitive images of different resolution. Then, we obtain local Luminance and Structural Index (LSI) in a locally adaptive manner on gradient maps which consider the luminance masking and contrast masking. At the same time we use Singular Value Decomposition (SVD) to obtain the Sharpness and Intrinsic Structural Index (SISI) to effectively capture the changes introduced in the image (due to distortion). Meanwhile, considering the disparity edge structures, we use gradient cross-mapping algorithm to obtain Depth Texture Structural Index (DTSI). After that, we apply the standard deviation method for the above results to obtain contrast index of reference and distortion components. Finally, for the loss caused by the randomness of the parameters, we use Support Vector Machine Regression based on Genetic Algorithm (GA-SVR) training to obtain the final quality score. We conducted a comprehensive evaluation with state-of-the-art methods on four open databases. The experimental results show that the proposed method has stable performance and strong competitive advantage.https://www.mdpi.com/1424-8220/22/2/499depth informationimage pyramidcyclopean mapstructural indexvisual sensitivity |
| spellingShingle | Hua Zhang Xinwen Hu Ruoyun Gou Lingjun Zhang Bolun Zheng Zhuonan Shen Rich Structural Index for Stereoscopic Image Quality Assessment Sensors depth information image pyramid cyclopean map structural index visual sensitivity |
| title | Rich Structural Index for Stereoscopic Image Quality Assessment |
| title_full | Rich Structural Index for Stereoscopic Image Quality Assessment |
| title_fullStr | Rich Structural Index for Stereoscopic Image Quality Assessment |
| title_full_unstemmed | Rich Structural Index for Stereoscopic Image Quality Assessment |
| title_short | Rich Structural Index for Stereoscopic Image Quality Assessment |
| title_sort | rich structural index for stereoscopic image quality assessment |
| topic | depth information image pyramid cyclopean map structural index visual sensitivity |
| url | https://www.mdpi.com/1424-8220/22/2/499 |
| work_keys_str_mv | AT huazhang richstructuralindexforstereoscopicimagequalityassessment AT xinwenhu richstructuralindexforstereoscopicimagequalityassessment AT ruoyungou richstructuralindexforstereoscopicimagequalityassessment AT lingjunzhang richstructuralindexforstereoscopicimagequalityassessment AT bolunzheng richstructuralindexforstereoscopicimagequalityassessment AT zhuonanshen richstructuralindexforstereoscopicimagequalityassessment |