Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes Classification

Human Action Recognition is a challenging task used in many applications. It interacts with many aspects of Computer Vision, Machine Learning, Deep Learning and Image Processing in order to understand human behaviours as well as identify them. It makes a significant contribution to sport analysis, b...

Full description

Bibliographic Details
Main Authors: Maria Skublewska-Paszkowska, Pawel Powroznik
Format: Article
Language:English
Published: MDPI AG 2023-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/5/2422
_version_ 1797614412173934592
author Maria Skublewska-Paszkowska
Pawel Powroznik
author_facet Maria Skublewska-Paszkowska
Pawel Powroznik
author_sort Maria Skublewska-Paszkowska
collection DOAJ
description Human Action Recognition is a challenging task used in many applications. It interacts with many aspects of Computer Vision, Machine Learning, Deep Learning and Image Processing in order to understand human behaviours as well as identify them. It makes a significant contribution to sport analysis, by indicating players’ performance level and training evaluation. The main purpose of this study is to investigate how the content of three-dimensional data influences on classification accuracy of four basic tennis strokes: forehand, backhand, volley forehand, and volley backhand. An entire player’s silhouette and its combination with a tennis racket were taken into consideration as input to the classifier. Three-dimensional data were recorded using the motion capture system (Vicon Oxford, UK). The Plug-in Gait model consisting of 39 retro-reflective markers was used for the player’s body acquisition. A seven-marker model was created for tennis racket capturing. The racket is represented in the form of a rigid body; therefore, all points associated with it changed their coordinates simultaneously. The Attention Temporal Graph Convolutional Network was applied for these sophisticated data. The highest accuracy, up to 93%, was achieved for the data of the whole player’s silhouette together with a tennis racket. The obtained results indicated that for dynamic movements, such as tennis strokes, it is necessary to analyze the position of the whole body of the player as well as the racket position.
first_indexed 2024-03-11T07:12:04Z
format Article
id doaj.art-fb5e913acfba4b16a91231bbd6e13fd2
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-11T07:12:04Z
publishDate 2023-02-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-fb5e913acfba4b16a91231bbd6e13fd22023-11-17T08:34:32ZengMDPI AGSensors1424-82202023-02-01235242210.3390/s23052422Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes ClassificationMaria Skublewska-Paszkowska0Pawel Powroznik1Department of Computer Science, Lublin University of Technology, 20-618 Lublin, PolandDepartment of Computer Science, Lublin University of Technology, 20-618 Lublin, PolandHuman Action Recognition is a challenging task used in many applications. It interacts with many aspects of Computer Vision, Machine Learning, Deep Learning and Image Processing in order to understand human behaviours as well as identify them. It makes a significant contribution to sport analysis, by indicating players’ performance level and training evaluation. The main purpose of this study is to investigate how the content of three-dimensional data influences on classification accuracy of four basic tennis strokes: forehand, backhand, volley forehand, and volley backhand. An entire player’s silhouette and its combination with a tennis racket were taken into consideration as input to the classifier. Three-dimensional data were recorded using the motion capture system (Vicon Oxford, UK). The Plug-in Gait model consisting of 39 retro-reflective markers was used for the player’s body acquisition. A seven-marker model was created for tennis racket capturing. The racket is represented in the form of a rigid body; therefore, all points associated with it changed their coordinates simultaneously. The Attention Temporal Graph Convolutional Network was applied for these sophisticated data. The highest accuracy, up to 93%, was achieved for the data of the whole player’s silhouette together with a tennis racket. The obtained results indicated that for dynamic movements, such as tennis strokes, it is necessary to analyze the position of the whole body of the player as well as the racket position.https://www.mdpi.com/1424-8220/23/5/2422sporttennis strokeshuman action recognitionA3T-GCNmotion capture
spellingShingle Maria Skublewska-Paszkowska
Pawel Powroznik
Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes Classification
Sensors
sport
tennis strokes
human action recognition
A3T-GCN
motion capture
title Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes Classification
title_full Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes Classification
title_fullStr Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes Classification
title_full_unstemmed Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes Classification
title_short Temporal Pattern Attention for Multivariate Time Series of Tennis Strokes Classification
title_sort temporal pattern attention for multivariate time series of tennis strokes classification
topic sport
tennis strokes
human action recognition
A3T-GCN
motion capture
url https://www.mdpi.com/1424-8220/23/5/2422
work_keys_str_mv AT mariaskublewskapaszkowska temporalpatternattentionformultivariatetimeseriesoftennisstrokesclassification
AT pawelpowroznik temporalpatternattentionformultivariatetimeseriesoftennisstrokesclassification