Guided Facial Skin Color Correction

This paper proposes an automatic image correction method for portrait photographs, which promotes consistency of facial skin color by suppressing skin color changes due to background colors. In portrait photographs, skin color is often distorted due to the lighting environment (e.g., light reflected...

Full description

Bibliographic Details
Main Authors: Keiichiro Shirai, Tatsuya Baba, Shunsuke Ono, Masahiro Okuda, Yusuke Tatesumi, Paul Perrotin
Format: Article
Language:English
Published: MDPI AG 2021-08-01
Series:Signals
Subjects:
Online Access:https://www.mdpi.com/2624-6120/2/3/33
_version_ 1797517230951366656
author Keiichiro Shirai
Tatsuya Baba
Shunsuke Ono
Masahiro Okuda
Yusuke Tatesumi
Paul Perrotin
author_facet Keiichiro Shirai
Tatsuya Baba
Shunsuke Ono
Masahiro Okuda
Yusuke Tatesumi
Paul Perrotin
author_sort Keiichiro Shirai
collection DOAJ
description This paper proposes an automatic image correction method for portrait photographs, which promotes consistency of facial skin color by suppressing skin color changes due to background colors. In portrait photographs, skin color is often distorted due to the lighting environment (e.g., light reflected from a colored background wall and over-exposure by a camera strobe). This color distortion is emphasized when artificially synthesized with another background color, and the appearance becomes unnatural. In our framework, we, first, roughly extract the face region and rectify the skin color distribution in a color space. Then, we perform color and brightness correction around the face in the original image to achieve a proper color balance of the facial image, which is not affected by luminance and background colors. Our color correction process attains natural results by using a guide image, unlike conventional algorithms. In particular, our guided image filtering for the color correction does not require a perfectly-aligned guide image required in the original guide image filtering method proposed by He et al. Experimental results show that our method generates more natural results than conventional methods on not only headshot photographs but also natural scene photographs. We also show automatic yearbook style photo generation as another application.
first_indexed 2024-03-10T07:13:51Z
format Article
id doaj.art-cf69d8258df94805906964fe370b3f04
institution Directory Open Access Journal
issn 2624-6120
language English
last_indexed 2024-03-10T07:13:51Z
publishDate 2021-08-01
publisher MDPI AG
record_format Article
series Signals
spelling doaj.art-cf69d8258df94805906964fe370b3f042023-11-22T15:15:55ZengMDPI AGSignals2624-61202021-08-012354055810.3390/signals2030033Guided Facial Skin Color CorrectionKeiichiro Shirai0Tatsuya Baba1Shunsuke Ono2Masahiro Okuda3Yusuke Tatesumi4Paul Perrotin5Faculty of Engineering, Shinshu University, 4-17-1 Wakasato, Nagano-shi 380-8553, JapanFaculty of Environmental Engineering, The University of Kitakyushu, 1-1 Hibikino, Wakamatsu-ku, Kitakyushu-shi 808-0135, JapanSchool of Computing, Tokyo Institute of Technology, G3-52 (Room 922), 4259 Nagatsuta-cho, Midori-ku, Yokohama-shi 226-8503, JapanFaculty of Science and Engineering, Doshisha University, 1-3 Tatara Miyakodani, Kyotanabe-shi 610-0394, JapanFaculty of Engineering, Shinshu University, 4-17-1 Wakasato, Nagano-shi 380-8553, JapanUniversity Institute of Technology La Rochelle, 15 Rue François de Vaux de Foletier, 17000 La Rochelle, FranceThis paper proposes an automatic image correction method for portrait photographs, which promotes consistency of facial skin color by suppressing skin color changes due to background colors. In portrait photographs, skin color is often distorted due to the lighting environment (e.g., light reflected from a colored background wall and over-exposure by a camera strobe). This color distortion is emphasized when artificially synthesized with another background color, and the appearance becomes unnatural. In our framework, we, first, roughly extract the face region and rectify the skin color distribution in a color space. Then, we perform color and brightness correction around the face in the original image to achieve a proper color balance of the facial image, which is not affected by luminance and background colors. Our color correction process attains natural results by using a guide image, unlike conventional algorithms. In particular, our guided image filtering for the color correction does not require a perfectly-aligned guide image required in the original guide image filtering method proposed by He et al. Experimental results show that our method generates more natural results than conventional methods on not only headshot photographs but also natural scene photographs. We also show automatic yearbook style photo generation as another application.https://www.mdpi.com/2624-6120/2/3/33auto correctioncolor correctioncolor gradingface recognitionguide image filtering
spellingShingle Keiichiro Shirai
Tatsuya Baba
Shunsuke Ono
Masahiro Okuda
Yusuke Tatesumi
Paul Perrotin
Guided Facial Skin Color Correction
Signals
auto correction
color correction
color grading
face recognition
guide image filtering
title Guided Facial Skin Color Correction
title_full Guided Facial Skin Color Correction
title_fullStr Guided Facial Skin Color Correction
title_full_unstemmed Guided Facial Skin Color Correction
title_short Guided Facial Skin Color Correction
title_sort guided facial skin color correction
topic auto correction
color correction
color grading
face recognition
guide image filtering
url https://www.mdpi.com/2624-6120/2/3/33
work_keys_str_mv AT keiichiroshirai guidedfacialskincolorcorrection
AT tatsuyababa guidedfacialskincolorcorrection
AT shunsukeono guidedfacialskincolorcorrection
AT masahirookuda guidedfacialskincolorcorrection
AT yusuketatesumi guidedfacialskincolorcorrection
AT paulperrotin guidedfacialskincolorcorrection