Learning a no-reference quality assessment model of enhanced images with big data
In this paper, we investigate into the problem of image quality assessment (IQA) and enhancement via machine learning. This issue has long attracted a wide range of attention in computational intelligence and image processing communities, since, for many practical applications, e.g., object detectio...
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2020
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/139879 |
| _version_ | 1811694911897993216 |
|---|---|
| author | Gu, Ke Tao, Dacheng Qiao, Jun-Fei Lin, Weisi |
| author2 | School of Computer Science and Engineering |
| author_facet | School of Computer Science and Engineering Gu, Ke Tao, Dacheng Qiao, Jun-Fei Lin, Weisi |
| author_sort | Gu, Ke |
| collection | NTU |
| description | In this paper, we investigate into the problem of image quality assessment (IQA) and enhancement via machine learning. This issue has long attracted a wide range of attention in computational intelligence and image processing communities, since, for many practical applications, e.g., object detection and recognition, raw images are usually needed to be appropriately enhanced to raise the visual quality (e.g., visibility and contrast). In fact, proper enhancement can noticeably improve the quality of input images, even better than originally captured images, which are generally thought to be of the best quality. In this paper, we present two most important contributions. The first contribution is to develop a new no-reference (NR) IQA model. Given an image, our quality measure first extracts 17 features through analysis of contrast, sharpness, brightness and more, and then yields a measure of visual quality using a regression module, which is learned with big-data training samples that are much bigger than the size of relevant image data sets. The results of experiments on nine data sets validate the superiority and efficiency of our blind metric compared with typical state-of-the-art full-reference, reduced-reference and NA IQA methods. The second contribution is that a robust image enhancement framework is established based on quality optimization. For an input image, by the guidance of the proposed NR-IQA measure, we conduct histogram modification to successively rectify image brightness and contrast to a proper level. Thorough tests demonstrate that our framework can well enhance natural images, low-contrast images, low-light images, and dehazed images. The source code will be released at https://sites.google.com/site/guke198701/publications. |
| first_indexed | 2024-10-01T07:15:06Z |
| format | Journal Article |
| id | ntu-10356/139879 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:15:06Z |
| publishDate | 2020 |
| record_format | dspace |
| spelling | ntu-10356/1398792020-05-22T06:03:11Z Learning a no-reference quality assessment model of enhanced images with big data Gu, Ke Tao, Dacheng Qiao, Jun-Fei Lin, Weisi School of Computer Science and Engineering Engineering::Computer science and engineering Big Data Learning Enhancement In this paper, we investigate into the problem of image quality assessment (IQA) and enhancement via machine learning. This issue has long attracted a wide range of attention in computational intelligence and image processing communities, since, for many practical applications, e.g., object detection and recognition, raw images are usually needed to be appropriately enhanced to raise the visual quality (e.g., visibility and contrast). In fact, proper enhancement can noticeably improve the quality of input images, even better than originally captured images, which are generally thought to be of the best quality. In this paper, we present two most important contributions. The first contribution is to develop a new no-reference (NR) IQA model. Given an image, our quality measure first extracts 17 features through analysis of contrast, sharpness, brightness and more, and then yields a measure of visual quality using a regression module, which is learned with big-data training samples that are much bigger than the size of relevant image data sets. The results of experiments on nine data sets validate the superiority and efficiency of our blind metric compared with typical state-of-the-art full-reference, reduced-reference and NA IQA methods. The second contribution is that a robust image enhancement framework is established based on quality optimization. For an input image, by the guidance of the proposed NR-IQA measure, we conduct histogram modification to successively rectify image brightness and contrast to a proper level. Thorough tests demonstrate that our framework can well enhance natural images, low-contrast images, low-light images, and dehazed images. The source code will be released at https://sites.google.com/site/guke198701/publications. MOE (Min. of Education, S’pore) 2020-05-22T06:03:11Z 2020-05-22T06:03:11Z 2017 Journal Article Gu, K., Tao, D., Qiao, J.-F., & Lin, W. (2018). Learning a no-reference quality assessment model of enhanced images with big data. IEEE Transactions on Neural Networks and Learning Systems, 29(4), 1301-1313. doi:10.1109/TNNLS.2017.2649101 2162-237X https://hdl.handle.net/10356/139879 10.1109/TNNLS.2017.2649101 28287984 2-s2.0-85014809373 4 29 1301 1313 en IEEE Transactions on Neural Networks and Learning Systems © 2017 IEEE. All rights reserved. |
| spellingShingle | Engineering::Computer science and engineering Big Data Learning Enhancement Gu, Ke Tao, Dacheng Qiao, Jun-Fei Lin, Weisi Learning a no-reference quality assessment model of enhanced images with big data |
| title | Learning a no-reference quality assessment model of enhanced images with big data |
| title_full | Learning a no-reference quality assessment model of enhanced images with big data |
| title_fullStr | Learning a no-reference quality assessment model of enhanced images with big data |
| title_full_unstemmed | Learning a no-reference quality assessment model of enhanced images with big data |
| title_short | Learning a no-reference quality assessment model of enhanced images with big data |
| title_sort | learning a no reference quality assessment model of enhanced images with big data |
| topic | Engineering::Computer science and engineering Big Data Learning Enhancement |
| url | https://hdl.handle.net/10356/139879 |
| work_keys_str_mv | AT guke learninganoreferencequalityassessmentmodelofenhancedimageswithbigdata AT taodacheng learninganoreferencequalityassessmentmodelofenhancedimageswithbigdata AT qiaojunfei learninganoreferencequalityassessmentmodelofenhancedimageswithbigdata AT linweisi learninganoreferencequalityassessmentmodelofenhancedimageswithbigdata |