Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.

Understanding the dynamic deformation pattern and biomechanical properties of breasts is crucial in various fields, including designing ergonomic bras and customized prostheses, as well as in clinical practice. Previous studies have recorded and analyzed the dynamic behaviors of the breast surface u...

Full description

Bibliographic Details
Main Authors: Qi-Long Liu, Kit-Lun Yick, Yue Sun, Joanne Yip
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2024-01-01
Series:PLoS ONE
Online Access:https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0299040&type=printable
_version_ 1797279647249989632
author Qi-Long Liu
Kit-Lun Yick
Yue Sun
Joanne Yip
author_facet Qi-Long Liu
Kit-Lun Yick
Yue Sun
Joanne Yip
author_sort Qi-Long Liu
collection DOAJ
description Understanding the dynamic deformation pattern and biomechanical properties of breasts is crucial in various fields, including designing ergonomic bras and customized prostheses, as well as in clinical practice. Previous studies have recorded and analyzed the dynamic behaviors of the breast surface using 4D scanning, which provides a sequence of 3D meshes during movement with high spatial and temporal resolutions. However, these studies are limited by the lack of robust and automated data processing methods which result in limited data coverage or error-prone analysis results. To address this issue, we identify revealing inter-frame dense correspondence as the core challenge towards conducting reliable and consistent analysis of the 4D scanning data. We proposed a fully-automatic approach named Ulta-dense Motion Capture (UdMC) using Thin-plate Spline (TPS) to augment the sparse landmarks recorded via motion capture (MoCap) as initial dense correspondence and then rectified it with a sophisticated post-alignment scheme. Two downstream tasks are demonstrated to validate its applicability: virtual landmark tracking and deformation intensity analysis. For evaluation, a dynamic 4D human breast anthropometric dataset DynaBreastLite was constructed. The results show that our approach can robustly capture the dynamic deformation characteristics of the breast surfaces, significantly outperforms baselines adapted from previous works in terms of accuracy, consistency, and efficiency. For 10 fps dataset, average error of 0.25 cm on control-landmarks and 0.33 cm on non-control (arbitrary) landmarks were achieved, with 17-70 times faster computation time. Evaluation was also carried out on 60 fps and 120 fps datasets, with consistent and large performance gaining being observed. The proposed method may contribute to advancing research in breast anthropometry, biomechanics, and ergonomics by enabling more accurate tracking of the breast surface deformation patterns and dynamic characteristics.
first_indexed 2024-03-07T16:29:02Z
format Article
id doaj.art-eef6c3ab90044e72844252073f232866
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-03-07T16:29:02Z
publishDate 2024-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-eef6c3ab90044e72844252073f2328662024-03-03T12:56:24ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-01192e029904010.1371/journal.pone.0299040Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.Qi-Long LiuKit-Lun YickYue SunJoanne YipUnderstanding the dynamic deformation pattern and biomechanical properties of breasts is crucial in various fields, including designing ergonomic bras and customized prostheses, as well as in clinical practice. Previous studies have recorded and analyzed the dynamic behaviors of the breast surface using 4D scanning, which provides a sequence of 3D meshes during movement with high spatial and temporal resolutions. However, these studies are limited by the lack of robust and automated data processing methods which result in limited data coverage or error-prone analysis results. To address this issue, we identify revealing inter-frame dense correspondence as the core challenge towards conducting reliable and consistent analysis of the 4D scanning data. We proposed a fully-automatic approach named Ulta-dense Motion Capture (UdMC) using Thin-plate Spline (TPS) to augment the sparse landmarks recorded via motion capture (MoCap) as initial dense correspondence and then rectified it with a sophisticated post-alignment scheme. Two downstream tasks are demonstrated to validate its applicability: virtual landmark tracking and deformation intensity analysis. For evaluation, a dynamic 4D human breast anthropometric dataset DynaBreastLite was constructed. The results show that our approach can robustly capture the dynamic deformation characteristics of the breast surfaces, significantly outperforms baselines adapted from previous works in terms of accuracy, consistency, and efficiency. For 10 fps dataset, average error of 0.25 cm on control-landmarks and 0.33 cm on non-control (arbitrary) landmarks were achieved, with 17-70 times faster computation time. Evaluation was also carried out on 60 fps and 120 fps datasets, with consistent and large performance gaining being observed. The proposed method may contribute to advancing research in breast anthropometry, biomechanics, and ergonomics by enabling more accurate tracking of the breast surface deformation patterns and dynamic characteristics.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0299040&type=printable
spellingShingle Qi-Long Liu
Kit-Lun Yick
Yue Sun
Joanne Yip
Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.
PLoS ONE
title Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.
title_full Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.
title_fullStr Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.
title_full_unstemmed Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.
title_short Ultra-dense Motion Capture: An exploratory full-automatic approach for dense tracking of breast motion in 4D.
title_sort ultra dense motion capture an exploratory full automatic approach for dense tracking of breast motion in 4d
url https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0299040&type=printable
work_keys_str_mv AT qilongliu ultradensemotioncaptureanexploratoryfullautomaticapproachfordensetrackingofbreastmotionin4d
AT kitlunyick ultradensemotioncaptureanexploratoryfullautomaticapproachfordensetrackingofbreastmotionin4d
AT yuesun ultradensemotioncaptureanexploratoryfullautomaticapproachfordensetrackingofbreastmotionin4d
AT joanneyip ultradensemotioncaptureanexploratoryfullautomaticapproachfordensetrackingofbreastmotionin4d