Adaptive restoration of pedestrian appearance in the spatiotemporal domain

Abstract Video synopsis based on visual rhythm has a small amount of calculation and strong representativeness, but the drawback is that the spatiotemporal pedestrians are distorted and illegible due to the loss of their own unique spatial morphology information, which leads to poor performance of v...

Full description

Bibliographic Details
Main Authors: Yunzuo Zhang, Yaning Guo, Jiayu Zhang
Format: Article
Language:English
Published: Wiley 2022-01-01
Series:The Journal of Engineering
Online Access:https://doi.org/10.1049/tje2.12086
_version_ 1819282318550892544
author Yunzuo Zhang
Yaning Guo
Jiayu Zhang
author_facet Yunzuo Zhang
Yaning Guo
Jiayu Zhang
author_sort Yunzuo Zhang
collection DOAJ
description Abstract Video synopsis based on visual rhythm has a small amount of calculation and strong representativeness, but the drawback is that the spatiotemporal pedestrians are distorted and illegible due to the loss of their own unique spatial morphology information, which leads to poor performance of video synopsis. To solve this problem, this letter proposed an adaptive restoration method of pedestrian appearance in the spatiotemporal domain. First, a single‐pixel row is taken as the sampling unit to complete the horizontal visual rhythm stitching; second, the relationship between the pedestrian spatiotemporal trajectory slope in the horizontal visual rhythm and the pedestrian movement speed is deduced; finally, the spatiotemporal trajectory slope is used as the basis for the vertical visual rhythm sampling width, and the adaptive restoration of pedestrian appearance in the spatiotemporal domain is completed. Experimental results show that the contour fluency and visual perception effect of pedestrian appearance restored by the proposed method are better, and the difference ratio of the proposed method is 0.08566, and the average running time is 421.0760 s, which has obvious advantages over the comparison method.
first_indexed 2024-12-24T01:13:41Z
format Article
id doaj.art-51507c8c8c054d8cb0a3e5e89c87496e
institution Directory Open Access Journal
issn 2051-3305
language English
last_indexed 2024-12-24T01:13:41Z
publishDate 2022-01-01
publisher Wiley
record_format Article
series The Journal of Engineering
spelling doaj.art-51507c8c8c054d8cb0a3e5e89c87496e2022-12-21T17:22:49ZengWileyThe Journal of Engineering2051-33052022-01-0120221101510.1049/tje2.12086Adaptive restoration of pedestrian appearance in the spatiotemporal domainYunzuo Zhang0Yaning Guo1Jiayu Zhang2School of Information Science and Technology Shijiazhuang Tiedao University Shijiazhuang Hebei People's Republic of ChinaSchool of Information Science and Technology Shijiazhuang Tiedao University Shijiazhuang Hebei People's Republic of ChinaSchool of Information Science and Technology Shijiazhuang Tiedao University Shijiazhuang Hebei People's Republic of ChinaAbstract Video synopsis based on visual rhythm has a small amount of calculation and strong representativeness, but the drawback is that the spatiotemporal pedestrians are distorted and illegible due to the loss of their own unique spatial morphology information, which leads to poor performance of video synopsis. To solve this problem, this letter proposed an adaptive restoration method of pedestrian appearance in the spatiotemporal domain. First, a single‐pixel row is taken as the sampling unit to complete the horizontal visual rhythm stitching; second, the relationship between the pedestrian spatiotemporal trajectory slope in the horizontal visual rhythm and the pedestrian movement speed is deduced; finally, the spatiotemporal trajectory slope is used as the basis for the vertical visual rhythm sampling width, and the adaptive restoration of pedestrian appearance in the spatiotemporal domain is completed. Experimental results show that the contour fluency and visual perception effect of pedestrian appearance restored by the proposed method are better, and the difference ratio of the proposed method is 0.08566, and the average running time is 421.0760 s, which has obvious advantages over the comparison method.https://doi.org/10.1049/tje2.12086
spellingShingle Yunzuo Zhang
Yaning Guo
Jiayu Zhang
Adaptive restoration of pedestrian appearance in the spatiotemporal domain
The Journal of Engineering
title Adaptive restoration of pedestrian appearance in the spatiotemporal domain
title_full Adaptive restoration of pedestrian appearance in the spatiotemporal domain
title_fullStr Adaptive restoration of pedestrian appearance in the spatiotemporal domain
title_full_unstemmed Adaptive restoration of pedestrian appearance in the spatiotemporal domain
title_short Adaptive restoration of pedestrian appearance in the spatiotemporal domain
title_sort adaptive restoration of pedestrian appearance in the spatiotemporal domain
url https://doi.org/10.1049/tje2.12086
work_keys_str_mv AT yunzuozhang adaptiverestorationofpedestrianappearanceinthespatiotemporaldomain
AT yaningguo adaptiverestorationofpedestrianappearanceinthespatiotemporaldomain
AT jiayuzhang adaptiverestorationofpedestrianappearanceinthespatiotemporaldomain