Synthetic Image Translation for Football Players Pose Estimation

In this paper, we present an approach for football players pose estimation on very low-resolution images. The camera recording the football match is far away from the pitch in order to register at least half of it. As a result, even using very high resolution cameras, the image area presenting every...

Full description

Bibliographic Details
Main Authors: Michał Sypetkowski, Grzegorz Sarwas, Tomasz Trzciński
Format: Article
Language:English
Published: Graz University of Technology 2019-06-01
Series:Journal of Universal Computer Science
Subjects:
Online Access:https://lib.jucs.org/article/22619/download/pdf/
_version_ 1818667896805523456
author Michał Sypetkowski
Grzegorz Sarwas
Tomasz Trzciński
author_facet Michał Sypetkowski
Grzegorz Sarwas
Tomasz Trzciński
author_sort Michał Sypetkowski
collection DOAJ
description In this paper, we present an approach for football players pose estimation on very low-resolution images. The camera recording the football match is far away from the pitch in order to register at least half of it. As a result, even using very high resolution cameras, the image area presenting every single player is very small. Additionally, variable weather conditions or shadows and reflections, make this aim very hard. Such images are very hard to annotate by human. In our research we assume lack of manually annotated training data from our target distribution. Instead of manual annotation of large dataset, we create simple python script for rendering synthetic images with perfect annotations. Then we train vanilla CycleGAN (Cycle-consistent Generative Adversarial Networks) for transformation of raw synthetic images into more realistic. We use transformed images to train CPN (Cascaded Pyramid Networks) model. Without bells and whistles, we achieve similar precision on our images as the same CPN model trained with COCO (Common Objects in Context) keypoints dataset.
first_indexed 2024-12-17T06:27:43Z
format Article
id doaj.art-e245729134d04ede8783c86a1216310e
institution Directory Open Access Journal
issn 0948-6968
language English
last_indexed 2024-12-17T06:27:43Z
publishDate 2019-06-01
publisher Graz University of Technology
record_format Article
series Journal of Universal Computer Science
spelling doaj.art-e245729134d04ede8783c86a1216310e2022-12-21T22:00:16ZengGraz University of TechnologyJournal of Universal Computer Science0948-69682019-06-0125668370010.3217/jucs-025-06-068322619Synthetic Image Translation for Football Players Pose EstimationMichał Sypetkowski0Grzegorz Sarwas1Tomasz Trzciński2Warsaw University of TechnologyWarsaw University of TechnologyWarsaw University of TechnologyIn this paper, we present an approach for football players pose estimation on very low-resolution images. The camera recording the football match is far away from the pitch in order to register at least half of it. As a result, even using very high resolution cameras, the image area presenting every single player is very small. Additionally, variable weather conditions or shadows and reflections, make this aim very hard. Such images are very hard to annotate by human. In our research we assume lack of manually annotated training data from our target distribution. Instead of manual annotation of large dataset, we create simple python script for rendering synthetic images with perfect annotations. Then we train vanilla CycleGAN (Cycle-consistent Generative Adversarial Networks) for transformation of raw synthetic images into more realistic. We use transformed images to train CPN (Cascaded Pyramid Networks) model. Without bells and whistles, we achieve similar precision on our images as the same CPN model trained with COCO (Common Objects in Context) keypoints dataset.https://lib.jucs.org/article/22619/download/pdf/pose estimationdeep convolutional neural network
spellingShingle Michał Sypetkowski
Grzegorz Sarwas
Tomasz Trzciński
Synthetic Image Translation for Football Players Pose Estimation
Journal of Universal Computer Science
pose estimation
deep convolutional neural network
title Synthetic Image Translation for Football Players Pose Estimation
title_full Synthetic Image Translation for Football Players Pose Estimation
title_fullStr Synthetic Image Translation for Football Players Pose Estimation
title_full_unstemmed Synthetic Image Translation for Football Players Pose Estimation
title_short Synthetic Image Translation for Football Players Pose Estimation
title_sort synthetic image translation for football players pose estimation
topic pose estimation
deep convolutional neural network
url https://lib.jucs.org/article/22619/download/pdf/
work_keys_str_mv AT michałsypetkowski syntheticimagetranslationforfootballplayersposeestimation
AT grzegorzsarwas syntheticimagetranslationforfootballplayersposeestimation
AT tomasztrzcinski syntheticimagetranslationforfootballplayersposeestimation