A Novel Approach to Image Recoloring for Color Vision Deficiency

In this paper, a novel method to modify color images for the protanopia and deuteranopia color vision deficiencies is proposed. The method admits certain criteria, such as preserving image naturalness and color contrast enhancement. Four modules are employed in the process. First, fuzzy clustering-b...

Full description

Bibliographic Details
Main Authors: George E. Tsekouras, Anastasios Rigos, Stamatis Chatzistamatis, John Tsimikas, Konstantinos Kotis, George Caridakis, Christos-Nikolaos Anagnostopoulos
Format: Article
Language:English
Published: MDPI AG 2021-04-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/8/2740
_version_ 1827695209203367936
author George E. Tsekouras
Anastasios Rigos
Stamatis Chatzistamatis
John Tsimikas
Konstantinos Kotis
George Caridakis
Christos-Nikolaos Anagnostopoulos
author_facet George E. Tsekouras
Anastasios Rigos
Stamatis Chatzistamatis
John Tsimikas
Konstantinos Kotis
George Caridakis
Christos-Nikolaos Anagnostopoulos
author_sort George E. Tsekouras
collection DOAJ
description In this paper, a novel method to modify color images for the protanopia and deuteranopia color vision deficiencies is proposed. The method admits certain criteria, such as preserving image naturalness and color contrast enhancement. Four modules are employed in the process. First, fuzzy clustering-based color segmentation extracts key colors (which are the cluster centers) of the input image. Second, the key colors are mapped onto the CIE 1931 chromaticity diagram. Then, using the concept of confusion line (i.e., loci of colors confused by the color-blind), a sophisticated mechanism translates (i.e., removes) key colors lying on the same confusion line to different confusion lines so that they can be discriminated by the color-blind. In the third module, the key colors are further adapted by optimizing a regularized objective function that combines the aforementioned criteria. Fourth, the recolored image is obtained by color transfer that involves the adapted key colors and the associated fuzzy clusters. Three related methods are compared with the proposed one, using two performance indices, and evaluated by several experiments over 195 natural images and six digitized art paintings. The main outcomes of the comparative analysis are as follows. (a) Quantitative evaluation based on nonparametric statistical analysis is conducted by comparing the proposed method to each one of the other three methods for protanopia and deuteranopia, and for each index. In most of the comparisons, the Bonferroni adjusted <i>p</i>-values are <0.015, favoring the superiority of the proposed method. (b) Qualitative evaluation verifies the aesthetic appearance of the recolored images. (c) Subjective evaluation supports the above results.
first_indexed 2024-03-10T12:22:17Z
format Article
id doaj.art-7f8658aaef2f4c96a69bf15b7d9a7afe
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T12:22:17Z
publishDate 2021-04-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-7f8658aaef2f4c96a69bf15b7d9a7afe2023-11-21T15:23:10ZengMDPI AGSensors1424-82202021-04-01218274010.3390/s21082740A Novel Approach to Image Recoloring for Color Vision DeficiencyGeorge E. Tsekouras0Anastasios Rigos1Stamatis Chatzistamatis2John Tsimikas3Konstantinos Kotis4George Caridakis5Christos-Nikolaos Anagnostopoulos6Department of Cultural Technology and Communications, University of the Aegean, 811 00 Mitilini, GreeceDepartment of Cultural Technology and Communications, University of the Aegean, 811 00 Mitilini, GreeceDepartment of Cultural Technology and Communications, University of the Aegean, 811 00 Mitilini, GreeceDepartment of Statistics and Actuarial-Financial Mathematics, University of the Aegean, 811 00 Mitilini, GreeceDepartment of Cultural Technology and Communications, University of the Aegean, 811 00 Mitilini, GreeceDepartment of Cultural Technology and Communications, University of the Aegean, 811 00 Mitilini, GreeceDepartment of Cultural Technology and Communications, University of the Aegean, 811 00 Mitilini, GreeceIn this paper, a novel method to modify color images for the protanopia and deuteranopia color vision deficiencies is proposed. The method admits certain criteria, such as preserving image naturalness and color contrast enhancement. Four modules are employed in the process. First, fuzzy clustering-based color segmentation extracts key colors (which are the cluster centers) of the input image. Second, the key colors are mapped onto the CIE 1931 chromaticity diagram. Then, using the concept of confusion line (i.e., loci of colors confused by the color-blind), a sophisticated mechanism translates (i.e., removes) key colors lying on the same confusion line to different confusion lines so that they can be discriminated by the color-blind. In the third module, the key colors are further adapted by optimizing a regularized objective function that combines the aforementioned criteria. Fourth, the recolored image is obtained by color transfer that involves the adapted key colors and the associated fuzzy clusters. Three related methods are compared with the proposed one, using two performance indices, and evaluated by several experiments over 195 natural images and six digitized art paintings. The main outcomes of the comparative analysis are as follows. (a) Quantitative evaluation based on nonparametric statistical analysis is conducted by comparing the proposed method to each one of the other three methods for protanopia and deuteranopia, and for each index. In most of the comparisons, the Bonferroni adjusted <i>p</i>-values are <0.015, favoring the superiority of the proposed method. (b) Qualitative evaluation verifies the aesthetic appearance of the recolored images. (c) Subjective evaluation supports the above results.https://www.mdpi.com/1424-8220/21/8/2740color vision deficiencyimage recoloringconfusion linechromaticity diagramfuzzy clusteringdifferential evolution
spellingShingle George E. Tsekouras
Anastasios Rigos
Stamatis Chatzistamatis
John Tsimikas
Konstantinos Kotis
George Caridakis
Christos-Nikolaos Anagnostopoulos
A Novel Approach to Image Recoloring for Color Vision Deficiency
Sensors
color vision deficiency
image recoloring
confusion line
chromaticity diagram
fuzzy clustering
differential evolution
title A Novel Approach to Image Recoloring for Color Vision Deficiency
title_full A Novel Approach to Image Recoloring for Color Vision Deficiency
title_fullStr A Novel Approach to Image Recoloring for Color Vision Deficiency
title_full_unstemmed A Novel Approach to Image Recoloring for Color Vision Deficiency
title_short A Novel Approach to Image Recoloring for Color Vision Deficiency
title_sort novel approach to image recoloring for color vision deficiency
topic color vision deficiency
image recoloring
confusion line
chromaticity diagram
fuzzy clustering
differential evolution
url https://www.mdpi.com/1424-8220/21/8/2740
work_keys_str_mv AT georgeetsekouras anovelapproachtoimagerecoloringforcolorvisiondeficiency
AT anastasiosrigos anovelapproachtoimagerecoloringforcolorvisiondeficiency
AT stamatischatzistamatis anovelapproachtoimagerecoloringforcolorvisiondeficiency
AT johntsimikas anovelapproachtoimagerecoloringforcolorvisiondeficiency
AT konstantinoskotis anovelapproachtoimagerecoloringforcolorvisiondeficiency
AT georgecaridakis anovelapproachtoimagerecoloringforcolorvisiondeficiency
AT christosnikolaosanagnostopoulos anovelapproachtoimagerecoloringforcolorvisiondeficiency
AT georgeetsekouras novelapproachtoimagerecoloringforcolorvisiondeficiency
AT anastasiosrigos novelapproachtoimagerecoloringforcolorvisiondeficiency
AT stamatischatzistamatis novelapproachtoimagerecoloringforcolorvisiondeficiency
AT johntsimikas novelapproachtoimagerecoloringforcolorvisiondeficiency
AT konstantinoskotis novelapproachtoimagerecoloringforcolorvisiondeficiency
AT georgecaridakis novelapproachtoimagerecoloringforcolorvisiondeficiency
AT christosnikolaosanagnostopoulos novelapproachtoimagerecoloringforcolorvisiondeficiency