Digital makeup using machine learning algorithms
Self-photographs, also known as selfies, have become indispensable in social media and the glamor industry. One’s face can be further enhanced with modern photo-editing software such as Adobe Photoshop. These makeup tools can digitally beautify the face with a click. Beauty industries have begun to...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2020
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/144579 |
| _version_ | 1826118741215150080 |
|---|---|
| author | Malani, Surabhi |
| author2 | He Ying |
| author_facet | He Ying Malani, Surabhi |
| author_sort | Malani, Surabhi |
| collection | NTU |
| description | Self-photographs, also known as selfies, have become indispensable in social media and the glamor industry. One’s face can be further enhanced with modern photo-editing software such as Adobe Photoshop. These makeup tools can digitally beautify the face with a click. Beauty industries have begun to embrace virtual makeup to support their customers’ online shopping experience.
The project aims to evaluate the proof of concept behind virtual makeup. It investigates the “how’s” and “what’s” behind the implementation of digital makeup, and also analyses how the program fared against different use cases. Curious individuals can experiment with how their appearance will change according to the latest trends, through a simple automated algorithm. The author implemented a state-of-the-art algorithm, in Python, for semantic segmentation of portrait images using fully convolutional networks (FCN) and other open-source libraries. This was followed by an example-based skin and hair colour transfer using N-dimensional Probability Density Function (PDF) statistical transfer. Ethnically diverse datasets were built with the photographs offered by enthusiastic photographers on the Internet. Colour transfer was done on a Part-to-Part basis between semantically similar features, and then parsed back onto the original image for a completed look.
The author has delivered an application that performed a full face-to-face makeup transfer involving a series of part-to-part colour transfer for each individual facial feature. The end results accurately capture the essence of the reference image. The application is able to obtain a reasonable segmentation of the input and reference image, and successfully performed a colour transfer, revealing visually aesthetic results. This resource-efficient program adopted high-performant technology, taking a total of 284 seconds to execute.
The colour transfer algorithm is not optimal when applied to humans because the human eye can easily perceive the distortion. Careful consideration can be made by ensuring that the input images have a relatively similar histogram distribution. Further research can be conducted to improve the algorithmic scope or even adopt more sophisticated and advanced technology that can parse makeup with content awareness. |
| first_indexed | 2024-10-01T04:48:25Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/144579 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T04:48:25Z |
| publishDate | 2020 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1445792020-11-13T02:53:34Z Digital makeup using machine learning algorithms Malani, Surabhi He Ying School of Computer Science and Engineering YHe@ntu.edu.sg Engineering::Computer science and engineering::Software Self-photographs, also known as selfies, have become indispensable in social media and the glamor industry. One’s face can be further enhanced with modern photo-editing software such as Adobe Photoshop. These makeup tools can digitally beautify the face with a click. Beauty industries have begun to embrace virtual makeup to support their customers’ online shopping experience. The project aims to evaluate the proof of concept behind virtual makeup. It investigates the “how’s” and “what’s” behind the implementation of digital makeup, and also analyses how the program fared against different use cases. Curious individuals can experiment with how their appearance will change according to the latest trends, through a simple automated algorithm. The author implemented a state-of-the-art algorithm, in Python, for semantic segmentation of portrait images using fully convolutional networks (FCN) and other open-source libraries. This was followed by an example-based skin and hair colour transfer using N-dimensional Probability Density Function (PDF) statistical transfer. Ethnically diverse datasets were built with the photographs offered by enthusiastic photographers on the Internet. Colour transfer was done on a Part-to-Part basis between semantically similar features, and then parsed back onto the original image for a completed look. The author has delivered an application that performed a full face-to-face makeup transfer involving a series of part-to-part colour transfer for each individual facial feature. The end results accurately capture the essence of the reference image. The application is able to obtain a reasonable segmentation of the input and reference image, and successfully performed a colour transfer, revealing visually aesthetic results. This resource-efficient program adopted high-performant technology, taking a total of 284 seconds to execute. The colour transfer algorithm is not optimal when applied to humans because the human eye can easily perceive the distortion. Careful consideration can be made by ensuring that the input images have a relatively similar histogram distribution. Further research can be conducted to improve the algorithmic scope or even adopt more sophisticated and advanced technology that can parse makeup with content awareness. Bachelor of Engineering (Computer Science) 2020-11-13T02:53:33Z 2020-11-13T02:53:33Z 2020 Final Year Project (FYP) https://hdl.handle.net/10356/144579 en SCSE19-0593 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Software Malani, Surabhi Digital makeup using machine learning algorithms |
| title | Digital makeup using machine learning algorithms |
| title_full | Digital makeup using machine learning algorithms |
| title_fullStr | Digital makeup using machine learning algorithms |
| title_full_unstemmed | Digital makeup using machine learning algorithms |
| title_short | Digital makeup using machine learning algorithms |
| title_sort | digital makeup using machine learning algorithms |
| topic | Engineering::Computer science and engineering::Software |
| url | https://hdl.handle.net/10356/144579 |
| work_keys_str_mv | AT malanisurabhi digitalmakeupusingmachinelearningalgorithms |