Blemishes change simulation for facial image retouching via physics-based modelling

Facial image retouching aims to remove facial blemishes from images, such as acne and pigmentation, and still retain textures and details. Nevertheless, existing methods just completely remove the blemishes but focus little on realism of the intermediate process, limiting their use more to beautifyi...

Full description

Bibliographic Details
Main Author: Shuai, Chenhao
Other Authors: Alex Chichung Kot
Format: Thesis-Master by Coursework
Language:English
Published: Nanyang Technological University 2024
Subjects:
Online Access:https://hdl.handle.net/10356/173577
_version_ 1826113297512923136
author Shuai, Chenhao
author2 Alex Chichung Kot
author_facet Alex Chichung Kot
Shuai, Chenhao
author_sort Shuai, Chenhao
collection NTU
description Facial image retouching aims to remove facial blemishes from images, such as acne and pigmentation, and still retain textures and details. Nevertheless, existing methods just completely remove the blemishes but focus little on realism of the intermediate process, limiting their use more to beautifying facial images on social media rather than being effective tools for simulating changes in facial pigmentation and acne to demonstrate the efficacy of skincare product to consumers or to assess the skincare product development. To bridge this critical gap, an efficient framework is proposed for simulating changes in skin blemishes. This method is based on prior knowledge that links the appearance of acne and pigmentation to melanin and heamoglobin chromophores under the skin surface. This novel framework models the spatial distributions of chromophores under the optical scattering properties of the skin. A unique feature of this framework is the precise and stable manipulation of parameters of chromophore distributions, thereby enabling control over the appearance of skin blemishes. The proposed framework is validated using a comprehensive dataset containing temporal data on long-term skin blemish changes. Experiment results show that this framework achieves highly realistic simulations. Furthermore, a visual perception study has also demonstrated the authenticity and quality of the proposed simulation method. Moreover, a user-friendly graphic interface is implemented to manipulate the facial blemishes interactively, achieving realistic and gradual blemishes retouching with an easy access.
first_indexed 2024-10-01T03:21:12Z
format Thesis-Master by Coursework
id ntu-10356/173577
institution Nanyang Technological University
language English
last_indexed 2024-10-01T03:21:12Z
publishDate 2024
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1735772024-02-16T15:42:31Z Blemishes change simulation for facial image retouching via physics-based modelling Shuai, Chenhao Alex Chichung Kot School of Electrical and Electronic Engineering eackot@ntu.edu.sg Computer and Information Science Facial image retouching aims to remove facial blemishes from images, such as acne and pigmentation, and still retain textures and details. Nevertheless, existing methods just completely remove the blemishes but focus little on realism of the intermediate process, limiting their use more to beautifying facial images on social media rather than being effective tools for simulating changes in facial pigmentation and acne to demonstrate the efficacy of skincare product to consumers or to assess the skincare product development. To bridge this critical gap, an efficient framework is proposed for simulating changes in skin blemishes. This method is based on prior knowledge that links the appearance of acne and pigmentation to melanin and heamoglobin chromophores under the skin surface. This novel framework models the spatial distributions of chromophores under the optical scattering properties of the skin. A unique feature of this framework is the precise and stable manipulation of parameters of chromophore distributions, thereby enabling control over the appearance of skin blemishes. The proposed framework is validated using a comprehensive dataset containing temporal data on long-term skin blemish changes. Experiment results show that this framework achieves highly realistic simulations. Furthermore, a visual perception study has also demonstrated the authenticity and quality of the proposed simulation method. Moreover, a user-friendly graphic interface is implemented to manipulate the facial blemishes interactively, achieving realistic and gradual blemishes retouching with an easy access. Master's degree 2024-02-15T02:58:53Z 2024-02-15T02:58:53Z 2023 Thesis-Master by Coursework Shuai, C. (2023). Blemishes change simulation for facial image retouching via physics-based modelling. Master's thesis, Nanyang Technological University, Singapore. https://hdl.handle.net/10356/173577 https://hdl.handle.net/10356/173577 en application/pdf Nanyang Technological University
spellingShingle Computer and Information Science
Shuai, Chenhao
Blemishes change simulation for facial image retouching via physics-based modelling
title Blemishes change simulation for facial image retouching via physics-based modelling
title_full Blemishes change simulation for facial image retouching via physics-based modelling
title_fullStr Blemishes change simulation for facial image retouching via physics-based modelling
title_full_unstemmed Blemishes change simulation for facial image retouching via physics-based modelling
title_short Blemishes change simulation for facial image retouching via physics-based modelling
title_sort blemishes change simulation for facial image retouching via physics based modelling
topic Computer and Information Science
url https://hdl.handle.net/10356/173577
work_keys_str_mv AT shuaichenhao blemisheschangesimulationforfacialimageretouchingviaphysicsbasedmodelling