Estimating Muscle Activity from the Deformation of a Sequential 3D Point Cloud

Estimation of muscle activity is very important as it can be a cue to assess a person’s movements and intentions. If muscle activity states can be obtained through non-contact measurement, through visual measurement systems, for example, muscle activity will provide data support and help for various...

Full description

Bibliographic Details
Main Authors: Hui Niu, Takahiro Ito, Damien Desclaux, Ko Ayusawa, Yusuke Yoshiyasu, Ryusuke Sagawa, Eiichi Yoshida
Format: Article
Language:English
Published: MDPI AG 2022-06-01
Series:Journal of Imaging
Subjects:
Online Access:https://www.mdpi.com/2313-433X/8/6/168
_version_ 1797485830591217664
author Hui Niu
Takahiro Ito
Damien Desclaux
Ko Ayusawa
Yusuke Yoshiyasu
Ryusuke Sagawa
Eiichi Yoshida
author_facet Hui Niu
Takahiro Ito
Damien Desclaux
Ko Ayusawa
Yusuke Yoshiyasu
Ryusuke Sagawa
Eiichi Yoshida
author_sort Hui Niu
collection DOAJ
description Estimation of muscle activity is very important as it can be a cue to assess a person’s movements and intentions. If muscle activity states can be obtained through non-contact measurement, through visual measurement systems, for example, muscle activity will provide data support and help for various study fields. In the present paper, we propose a method to predict human muscle activity from skin surface strain. This requires us to obtain a 3D reconstruction model with a high relative accuracy. The problem is that reconstruction errors due to noise on raw data generated in a visual measurement system are inevitable. In particular, the independent noise between each frame on the time series makes it difficult to accurately track the motion. In order to obtain more precise information about the human skin surface, we propose a method that introduces a temporal constraint in the non-rigid registration process. We can achieve more accurate tracking of shape and motion by constraining the point cloud motion over the time series. Using surface strain as input, we build a multilayer perceptron artificial neural network for inferring muscle activity. In the present paper, we investigate simple lower limb movements to train the network. As a result, we successfully achieve the estimation of muscle activity via surface strain.
first_indexed 2024-03-09T23:24:29Z
format Article
id doaj.art-6e79077083404d89bb963187746feb5e
institution Directory Open Access Journal
issn 2313-433X
language English
last_indexed 2024-03-09T23:24:29Z
publishDate 2022-06-01
publisher MDPI AG
record_format Article
series Journal of Imaging
spelling doaj.art-6e79077083404d89bb963187746feb5e2023-11-23T17:20:38ZengMDPI AGJournal of Imaging2313-433X2022-06-018616810.3390/jimaging8060168Estimating Muscle Activity from the Deformation of a Sequential 3D Point CloudHui Niu0Takahiro Ito1Damien Desclaux2Ko Ayusawa3Yusuke Yoshiyasu4Ryusuke Sagawa5Eiichi Yoshida6National Institute of Advanced Industrial Science and Technology, Tsukuba 305-8560, JapanNational Institute of Advanced Industrial Science and Technology, Tsukuba 305-8560, JapanCNRS-AIST JRL (Joint Robotics Laboratory), IRL, Tsukuba 305-8560, JapanNational Institute of Advanced Industrial Science and Technology, Tsukuba 305-8560, JapanNational Institute of Advanced Industrial Science and Technology, Tsukuba 305-8560, JapanNational Institute of Advanced Industrial Science and Technology, Tsukuba 305-8560, JapanNational Institute of Advanced Industrial Science and Technology, Tsukuba 305-8560, JapanEstimation of muscle activity is very important as it can be a cue to assess a person’s movements and intentions. If muscle activity states can be obtained through non-contact measurement, through visual measurement systems, for example, muscle activity will provide data support and help for various study fields. In the present paper, we propose a method to predict human muscle activity from skin surface strain. This requires us to obtain a 3D reconstruction model with a high relative accuracy. The problem is that reconstruction errors due to noise on raw data generated in a visual measurement system are inevitable. In particular, the independent noise between each frame on the time series makes it difficult to accurately track the motion. In order to obtain more precise information about the human skin surface, we propose a method that introduces a temporal constraint in the non-rigid registration process. We can achieve more accurate tracking of shape and motion by constraining the point cloud motion over the time series. Using surface strain as input, we build a multilayer perceptron artificial neural network for inferring muscle activity. In the present paper, we investigate simple lower limb movements to train the network. As a result, we successfully achieve the estimation of muscle activity via surface strain.https://www.mdpi.com/2313-433X/8/6/168muscle activitystrainnon-rigid registrationpoint cloudmultilayer perceptron
spellingShingle Hui Niu
Takahiro Ito
Damien Desclaux
Ko Ayusawa
Yusuke Yoshiyasu
Ryusuke Sagawa
Eiichi Yoshida
Estimating Muscle Activity from the Deformation of a Sequential 3D Point Cloud
Journal of Imaging
muscle activity
strain
non-rigid registration
point cloud
multilayer perceptron
title Estimating Muscle Activity from the Deformation of a Sequential 3D Point Cloud
title_full Estimating Muscle Activity from the Deformation of a Sequential 3D Point Cloud
title_fullStr Estimating Muscle Activity from the Deformation of a Sequential 3D Point Cloud
title_full_unstemmed Estimating Muscle Activity from the Deformation of a Sequential 3D Point Cloud
title_short Estimating Muscle Activity from the Deformation of a Sequential 3D Point Cloud
title_sort estimating muscle activity from the deformation of a sequential 3d point cloud
topic muscle activity
strain
non-rigid registration
point cloud
multilayer perceptron
url https://www.mdpi.com/2313-433X/8/6/168
work_keys_str_mv AT huiniu estimatingmuscleactivityfromthedeformationofasequential3dpointcloud
AT takahiroito estimatingmuscleactivityfromthedeformationofasequential3dpointcloud
AT damiendesclaux estimatingmuscleactivityfromthedeformationofasequential3dpointcloud
AT koayusawa estimatingmuscleactivityfromthedeformationofasequential3dpointcloud
AT yusukeyoshiyasu estimatingmuscleactivityfromthedeformationofasequential3dpointcloud
AT ryusukesagawa estimatingmuscleactivityfromthedeformationofasequential3dpointcloud
AT eiichiyoshida estimatingmuscleactivityfromthedeformationofasequential3dpointcloud