Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment
Reduced-reference (RR) image quality assessment (IQA), which aims to use a small amount of the reference information but achieve high accuracy, is greatly demanded in quality-orientated systems. In order to design a better RR IQA model which performs consistently with the subjective perception, the...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2018-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8270602/ |
| _version_ | 1818641735503314944 |
|---|---|
| author | Jinjian Wu Yongxu Liu Leida Li Guangming Shi |
| author_facet | Jinjian Wu Yongxu Liu Leida Li Guangming Shi |
| author_sort | Jinjian Wu |
| collection | DOAJ |
| description | Reduced-reference (RR) image quality assessment (IQA), which aims to use a small amount of the reference information but achieve high accuracy, is greatly demanded in quality-orientated systems. In order to design a better RR IQA model which performs consistently with the subjective perception, the inner mechanism of the human visual system (HVS) is usually investigated and imitated. In this paper, the attention mechanism is thoroughly analyzed and used for RR IQA modeling. Generally, the HVS is more sensitive to the distortion on the attended region than that on the unattended region. Thus, the saliency of each region is calculated to highlight its importance, and a saliency weighted local structure (SWLS)-based histogram is created for visual structure degradation measurement. Meanwhile, the distortion may cause attention shift (changing the attended region). In other words, the difference of attention between the reference and distorted images can efficiently represent the quality degradation. Therefore, the attention distribution is analyzed with the salient map, and an orientation located global saliency (OLGS)-based histogram is built for attention shift measurement. Finally, combining the quality degradations from both SWLS and OLGS, a novel attended visual content degradation-based RR IQA method is introduced.<sup>1</sup> Experimental results demonstrate that the proposed method uses only several values (18 values) and performs consistently with the subjective perception. Moreover, the proposed attention procedure can be easily extended to the existing RR IQA models and improve their performances. |
| first_indexed | 2024-12-16T23:31:53Z |
| format | Article |
| id | doaj.art-ec62fc4d93334440b41a80bb17bab6fb |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-16T23:31:53Z |
| publishDate | 2018-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ec62fc4d93334440b41a80bb17bab6fb2022-12-21T22:11:52ZengIEEEIEEE Access2169-35362018-01-016124931250410.1109/ACCESS.2018.27985738270602Attended Visual Content Degradation Based Reduced Reference Image Quality AssessmentJinjian Wu0https://orcid.org/0000-0001-7501-0009Yongxu Liu1Leida Li2Guangming Shi3https://orcid.org/0000-0003-2179-3292Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi’an, ChinaKey Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi’an, ChinaSchool of Information and Electrical Engineering, China University of Mining and Technology, Xuzhou, ChinaKey Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi’an, ChinaReduced-reference (RR) image quality assessment (IQA), which aims to use a small amount of the reference information but achieve high accuracy, is greatly demanded in quality-orientated systems. In order to design a better RR IQA model which performs consistently with the subjective perception, the inner mechanism of the human visual system (HVS) is usually investigated and imitated. In this paper, the attention mechanism is thoroughly analyzed and used for RR IQA modeling. Generally, the HVS is more sensitive to the distortion on the attended region than that on the unattended region. Thus, the saliency of each region is calculated to highlight its importance, and a saliency weighted local structure (SWLS)-based histogram is created for visual structure degradation measurement. Meanwhile, the distortion may cause attention shift (changing the attended region). In other words, the difference of attention between the reference and distorted images can efficiently represent the quality degradation. Therefore, the attention distribution is analyzed with the salient map, and an orientation located global saliency (OLGS)-based histogram is built for attention shift measurement. Finally, combining the quality degradations from both SWLS and OLGS, a novel attended visual content degradation-based RR IQA method is introduced.<sup>1</sup> Experimental results demonstrate that the proposed method uses only several values (18 values) and performs consistently with the subjective perception. Moreover, the proposed attention procedure can be easily extended to the existing RR IQA models and improve their performances.https://ieeexplore.ieee.org/document/8270602/Reduced-reference (RR)image quality assessment (IQA)visual attentionsaliencycontent degradation |
| spellingShingle | Jinjian Wu Yongxu Liu Leida Li Guangming Shi Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment IEEE Access Reduced-reference (RR) image quality assessment (IQA) visual attention saliency content degradation |
| title | Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment |
| title_full | Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment |
| title_fullStr | Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment |
| title_full_unstemmed | Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment |
| title_short | Attended Visual Content Degradation Based Reduced Reference Image Quality Assessment |
| title_sort | attended visual content degradation based reduced reference image quality assessment |
| topic | Reduced-reference (RR) image quality assessment (IQA) visual attention saliency content degradation |
| url | https://ieeexplore.ieee.org/document/8270602/ |
| work_keys_str_mv | AT jinjianwu attendedvisualcontentdegradationbasedreducedreferenceimagequalityassessment AT yongxuliu attendedvisualcontentdegradationbasedreducedreferenceimagequalityassessment AT leidali attendedvisualcontentdegradationbasedreducedreferenceimagequalityassessment AT guangmingshi attendedvisualcontentdegradationbasedreducedreferenceimagequalityassessment |