Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.

We propose an anisotropic constrained-boundary convolutional neural networks (hereafter, AnisoCBConvNet) that can stably express high-quality meshes without oscillation by applying super-resolution operations to low-resolution cloth meshes. As a training set for the neural network, we use a pair bet...

Full description

Bibliographic Details
Main Authors: Jong-Hyun Kim, Sun-Jeong Kim, Jung Lee
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2022-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0272433
_version_ 1798032608283590656
author Jong-Hyun Kim
Sun-Jeong Kim
Jung Lee
author_facet Jong-Hyun Kim
Sun-Jeong Kim
Jung Lee
author_sort Jong-Hyun Kim
collection DOAJ
description We propose an anisotropic constrained-boundary convolutional neural networks (hereafter, AnisoCBConvNet) that can stably express high-quality meshes without oscillation by applying super-resolution operations to low-resolution cloth meshes. As a training set for the neural network, we use a pair between simulation data of low resolution (LR) cloth and data obtained by applying the same simulation to high resolution (HR) cloth with increased quad mesh resolution of LR cloth. The actual data used for training are 2D geometry images converted from 3D meshes. The proposed AnisoCBConvNet is used to train an image synthesizer that converts LR geometry images to HR geometry images. In particular, by controlling the weights anisotropically near the boundary, the problem of surface wrinkling caused by oscillation is alleviated. When the HR geometry image obtained through AnisoCBConvNet is converted back to the HR cloth mesh, details including wrinkles are expressed better than the input cloth mesh. In addition, our results improved the noise problem in the existing geometry image approach. We tested AnisoCBConvNet-based super-resolution in various simulation scenarios, and confirmed stable and efficient performance in most of the results. By using our method, it will be possible to effectively produce CG VFX created using high-quality cloth simulation in games and movies.
first_indexed 2024-04-11T20:16:41Z
format Article
id doaj.art-1ea33a8c3bd54143bea45d1558343b20
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-04-11T20:16:41Z
publishDate 2022-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-1ea33a8c3bd54143bea45d1558343b202022-12-22T04:04:56ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-01178e027243310.1371/journal.pone.0272433Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.Jong-Hyun KimSun-Jeong KimJung LeeWe propose an anisotropic constrained-boundary convolutional neural networks (hereafter, AnisoCBConvNet) that can stably express high-quality meshes without oscillation by applying super-resolution operations to low-resolution cloth meshes. As a training set for the neural network, we use a pair between simulation data of low resolution (LR) cloth and data obtained by applying the same simulation to high resolution (HR) cloth with increased quad mesh resolution of LR cloth. The actual data used for training are 2D geometry images converted from 3D meshes. The proposed AnisoCBConvNet is used to train an image synthesizer that converts LR geometry images to HR geometry images. In particular, by controlling the weights anisotropically near the boundary, the problem of surface wrinkling caused by oscillation is alleviated. When the HR geometry image obtained through AnisoCBConvNet is converted back to the HR cloth mesh, details including wrinkles are expressed better than the input cloth mesh. In addition, our results improved the noise problem in the existing geometry image approach. We tested AnisoCBConvNet-based super-resolution in various simulation scenarios, and confirmed stable and efficient performance in most of the results. By using our method, it will be possible to effectively produce CG VFX created using high-quality cloth simulation in games and movies.https://doi.org/10.1371/journal.pone.0272433
spellingShingle Jong-Hyun Kim
Sun-Jeong Kim
Jung Lee
Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.
PLoS ONE
title Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.
title_full Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.
title_fullStr Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.
title_full_unstemmed Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.
title_short Geometry image super-resolution with AnisoCBConvNet architecture for efficient cloth modeling.
title_sort geometry image super resolution with anisocbconvnet architecture for efficient cloth modeling
url https://doi.org/10.1371/journal.pone.0272433
work_keys_str_mv AT jonghyunkim geometryimagesuperresolutionwithanisocbconvnetarchitectureforefficientclothmodeling
AT sunjeongkim geometryimagesuperresolutionwithanisocbconvnetarchitectureforefficientclothmodeling
AT junglee geometryimagesuperresolutionwithanisocbconvnetarchitectureforefficientclothmodeling