Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer Problem

The task of image style transfer is to create a new, previously non-existent image by combining two given images ‒ the original image and the styled image. The original image forms the structure, basic geometric lines and shapes of the resulting image, while the styled image sets the colour and text...

Full description

Bibliographic Details
Main Author: Moutouama N’dah Bienvenu Mouale
Format: Article
Language:Russian
Published: The Fund for Promotion of Internet media, IT education, human development «League Internet Media» 2022-07-01
Series:Современные информационные технологии и IT-образование
Subjects:
Online Access:http://sitito.cs.msu.ru/index.php/SITITO/article/view/854
_version_ 1797955817600712704
author Moutouama N’dah Bienvenu Mouale
author_facet Moutouama N’dah Bienvenu Mouale
author_sort Moutouama N’dah Bienvenu Mouale
collection DOAJ
description The task of image style transfer is to create a new, previously non-existent image by combining two given images ‒ the original image and the styled image. The original image forms the structure, basic geometric lines and shapes of the resulting image, while the styled image sets the colour and texture of the result. The essence of this approach is that a certain image is transformed into a new one with a different style that has been set. To solve such problems, convolutional neural networks are usually used. The input to the neural network is two pictures: content and style. For example, a photograph, and the style is a painting by a famous artist. The resulting image would then be the scene depicted in the original picture, styled in the style of that picture. Modern style transfer algorithms give good results, but the result of such algorithms is either unacceptable due to excessive distortion of facial features, or weakly expressed, not bearing the characteristic features of the style image. In this paper, we consider how to adapt a pre-trained model in solving the image classification and transfer problem, so that the result is an image that is coloured according to the original image and highly pronounced. Our main contribution is to propose a new method for image processing and style transfer based on the pre-trained VGG16 model.
first_indexed 2024-04-10T23:39:04Z
format Article
id doaj.art-2b505731f98f43cb8d8c759f458da707
institution Directory Open Access Journal
issn 2411-1473
language Russian
last_indexed 2024-04-10T23:39:04Z
publishDate 2022-07-01
publisher The Fund for Promotion of Internet media, IT education, human development «League Internet Media»
record_format Article
series Современные информационные технологии и IT-образование
spelling doaj.art-2b505731f98f43cb8d8c759f458da7072023-01-11T11:37:42ZrusThe Fund for Promotion of Internet media, IT education, human development «League Internet Media»Современные информационные технологии и IT-образование2411-14732022-07-0118224124810.25559/SITITO.18.202202.241-248Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer ProblemMoutouama N’dah Bienvenu Mouale0https://orcid.org/0000-0002-7230-5714Peoples' Friendship University of Russia, Moscow, RussiaThe task of image style transfer is to create a new, previously non-existent image by combining two given images ‒ the original image and the styled image. The original image forms the structure, basic geometric lines and shapes of the resulting image, while the styled image sets the colour and texture of the result. The essence of this approach is that a certain image is transformed into a new one with a different style that has been set. To solve such problems, convolutional neural networks are usually used. The input to the neural network is two pictures: content and style. For example, a photograph, and the style is a painting by a famous artist. The resulting image would then be the scene depicted in the original picture, styled in the style of that picture. Modern style transfer algorithms give good results, but the result of such algorithms is either unacceptable due to excessive distortion of facial features, or weakly expressed, not bearing the characteristic features of the style image. In this paper, we consider how to adapt a pre-trained model in solving the image classification and transfer problem, so that the result is an image that is coloured according to the original image and highly pronounced. Our main contribution is to propose a new method for image processing and style transfer based on the pre-trained VGG16 model.http://sitito.cs.msu.ru/index.php/SITITO/article/view/854face recognitionimage recognitionconvolutional neural networksbounding boxanchorregional convolutional neural networks model
spellingShingle Moutouama N’dah Bienvenu Mouale
Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer Problem
Современные информационные технологии и IT-образование
face recognition
image recognition
convolutional neural networks
bounding box
anchor
regional convolutional neural networks model
title Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer Problem
title_full Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer Problem
title_fullStr Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer Problem
title_full_unstemmed Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer Problem
title_short Using a Pre-Trained Neural Network (VGG 16) to Solve the Image Style Transfer Problem
title_sort using a pre trained neural network vgg 16 to solve the image style transfer problem
topic face recognition
image recognition
convolutional neural networks
bounding box
anchor
regional convolutional neural networks model
url http://sitito.cs.msu.ru/index.php/SITITO/article/view/854
work_keys_str_mv AT moutouamandahbienvenumouale usingapretrainedneuralnetworkvgg16tosolvetheimagestyletransferproblem