Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics

High dynamic range (HDR) images give a strong disposition to capture all parts of natural scene information due to their wider brightness range than traditional low dynamic range (LDR) images. However, to visualize HDR images on common LDR displays, tone mapping operations (TMOs) are extra required,...

Full description

Bibliographic Details
Main Authors: Zhouyan He, Mei Yu, Fen Chen, Zongju Peng, Haiyong Xu, Yang Song
Format: Article
Language:English
Published: MDPI AG 2020-07-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/22/8/850
_version_ 1827711863793647616
author Zhouyan He
Mei Yu
Fen Chen
Zongju Peng
Haiyong Xu
Yang Song
author_facet Zhouyan He
Mei Yu
Fen Chen
Zongju Peng
Haiyong Xu
Yang Song
author_sort Zhouyan He
collection DOAJ
description High dynamic range (HDR) images give a strong disposition to capture all parts of natural scene information due to their wider brightness range than traditional low dynamic range (LDR) images. However, to visualize HDR images on common LDR displays, tone mapping operations (TMOs) are extra required, which inevitably lead to visual quality degradation, especially in the bright and dark regions. To evaluate the performance of different TMOs accurately, this paper proposes a blind tone-mapped image quality assessment method based on regional sparse response and aesthetics (RSRA-BTMI) by considering the influences of detail information and color on the human visual system. Specifically, for the detail loss in a tone-mapped image (TMI), multi-dictionaries are first designed for different brightness regions and whole TMI. Then regional sparse atoms aggregated by local entropy and global reconstruction residuals are presented to characterize the regional and global detail distortion in TMI, respectively. Besides, a few efficient aesthetic features are extracted to measure the color unnaturalness of TMI. Finally, all extracted features are linked with relevant subjective scores to conduct quality regression via random forest. Experimental results on the ESPL-LIVE HDR database demonstrate that the proposed RSRA-BTMI method is superior to the existing state-of-the-art blind TMI quality assessment methods.
first_indexed 2024-03-10T18:03:32Z
format Article
id doaj.art-c53c866f3566448382421f83e34bdf1f
institution Directory Open Access Journal
issn 1099-4300
language English
last_indexed 2024-03-10T18:03:32Z
publishDate 2020-07-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj.art-c53c866f3566448382421f83e34bdf1f2023-11-20T08:41:38ZengMDPI AGEntropy1099-43002020-07-0122885010.3390/e22080850Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and AestheticsZhouyan He0Mei Yu1Fen Chen2Zongju Peng3Haiyong Xu4Yang Song5Faculty of Information Science and Engineering, Ningbo University, Ningbo 315211, ChinaFaculty of Information Science and Engineering, Ningbo University, Ningbo 315211, ChinaFaculty of Information Science and Engineering, Ningbo University, Ningbo 315211, ChinaFaculty of Information Science and Engineering, Ningbo University, Ningbo 315211, ChinaFaculty of Information Science and Engineering, Ningbo University, Ningbo 315211, ChinaFaculty of Information Science and Engineering, Ningbo University, Ningbo 315211, ChinaHigh dynamic range (HDR) images give a strong disposition to capture all parts of natural scene information due to their wider brightness range than traditional low dynamic range (LDR) images. However, to visualize HDR images on common LDR displays, tone mapping operations (TMOs) are extra required, which inevitably lead to visual quality degradation, especially in the bright and dark regions. To evaluate the performance of different TMOs accurately, this paper proposes a blind tone-mapped image quality assessment method based on regional sparse response and aesthetics (RSRA-BTMI) by considering the influences of detail information and color on the human visual system. Specifically, for the detail loss in a tone-mapped image (TMI), multi-dictionaries are first designed for different brightness regions and whole TMI. Then regional sparse atoms aggregated by local entropy and global reconstruction residuals are presented to characterize the regional and global detail distortion in TMI, respectively. Besides, a few efficient aesthetic features are extracted to measure the color unnaturalness of TMI. Finally, all extracted features are linked with relevant subjective scores to conduct quality regression via random forest. Experimental results on the ESPL-LIVE HDR database demonstrate that the proposed RSRA-BTMI method is superior to the existing state-of-the-art blind TMI quality assessment methods.https://www.mdpi.com/1099-4300/22/8/850high dynamic range imagetone-mappingimage quality assessmentregional sparse responseaestheticsentropy weighting
spellingShingle Zhouyan He
Mei Yu
Fen Chen
Zongju Peng
Haiyong Xu
Yang Song
Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
Entropy
high dynamic range image
tone-mapping
image quality assessment
regional sparse response
aesthetics
entropy weighting
title Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_full Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_fullStr Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_full_unstemmed Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_short Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_sort blind tone mapped image quality assessment based on regional sparse response and aesthetics
topic high dynamic range image
tone-mapping
image quality assessment
regional sparse response
aesthetics
entropy weighting
url https://www.mdpi.com/1099-4300/22/8/850
work_keys_str_mv AT zhouyanhe blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT meiyu blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT fenchen blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT zongjupeng blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT haiyongxu blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT yangsong blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics