Neural Sign Language Translation Based on Human Keypoint Estimation

Neural Sign Language Translation Based on Human Keypoint Estimation

We propose a sign language translation system based on human keypoint estimation. It is well-known that many problems in the field of computer vision require a massive dataset to train deep neural network models. The situation is even worse when it comes to the sign language translation problem as i...

Полное описание

Библиографические подробности
Главные авторы:	Sang-Ki Ko, Chang Jo Kim, Hyedong Jung, Choongsang Cho
Формат:	Статья
Язык:	English
Опубликовано:	MDPI AG 2019-07-01
Серии:	Applied Sciences
Предметы:	sign language translation human keypoint detection deep learning sequence-to-sequence model
Online-ссылка:	https://www.mdpi.com/2076-3417/9/13/2683

Схожие документы

Preprocessing for Keypoint-Based Sign Language Translation without Glosses
по: Youngmin Kim, и др.
Опубликовано: (2023-03-01)

Unbiased evaluation of keypoint detectors with respect to rotation invariance
по: Karol Matusiak, и др.
Опубликовано: (2017-10-01)

An Improved Deep Keypoint Detection Network for Space Targets Pose Estimation
по: Junjie Xu, и др.
Опубликовано: (2020-11-01)

Creating a Parallel Corpus for the Kazakh Sign Language and Learning
по: Aigerim Yerimbetova, и др.
Опубликовано: (2025-03-01)

Comparison of Keypoint Detectors and Descriptors for Relative Radiometric Normalization of Bitemporal Remote Sensing Images
по: Armin Moghimi, и др.
Опубликовано: (2021-01-01)

Deteksi Keypoint pada Markerless Augmented Reality untuk Design Furniture Room
по: Sri Desy Siswanti, и др.
Опубликовано: (2016-11-01)

Leveraging Frozen Pretrained Written Language Models for Neural Sign Language Translation
по: Mathieu De Coster, и др.
Опубликовано: (2022-04-01)

Research Method of Discontinuous-Gait Image Recognition Based on Human Skeleton Keypoint Extraction
по: Kun Han, и др.
Опубликовано: (2023-08-01)

Blur-Countering Keypoint Detection via Eigenvalue Asymmetry
по: Chao Zhang, и др.
Опубликовано: (2020-01-01)

Deconvolution Enhancement Keypoint Network for Efficient Fish Fry Counting
по: Ximing Li, и др.
Опубликовано: (2024-05-01)

Learning by Watching via Keypoint Extraction and Imitation Learning
по: Yin-Tung Albert Sun, и др.
Опубликовано: (2022-11-01)

Novel Spatio-Temporal Continuous Sign Language Recognition Using an Attentive Multi-Feature Network
по: Wisnu Aditya, и др.
Опубликовано: (2022-08-01)

Estimating 6D Aircraft Pose from Keypoints and Structures
по: Runze Fan, и др.
Опубликовано: (2021-02-01)

Adaptive Granularity-Fused Keypoint Detection for 6D Pose Estimation of Space Targets
по: Xu Gu, и др.
Опубликовано: (2024-11-01)

Using Information Content to Select Keypoints for UAV Image Matching
по: Vahid Mousavi, и др.
Опубликовано: (2021-03-01)

Survey of Sign Language Recognition and Translation
по: YAN Siyi, XUE Wanli, YUAN Tiantian
Опубликовано: (2022-11-01)

AfriSign: African sign languages machine translation
по: Kate Takyi, и др.
Опубликовано: (2025-01-01)

Monocular 3D Object Detection Based on Uncertainty Prediction of Keypoints
по: Mu Chen, и др.
Опубликовано: (2021-12-01)

Bible For The Deaf: Implication For Sign Language Bible Translation
по: Ruth Oyeniyi
Опубликовано: (2020-04-01)

Smart Application for Thai and English Sign Language Translation
по: Sahachok Khumwongsa, и др.
Опубликовано: (2023-09-01)

Translating Poetry in Sign Language: An Embodied Perspective
по: Erika Raniolo
Опубликовано: (2022-05-01)

Synthetic Corpus Generation for Deep Learning-Based Translation of Spanish Sign Language
по: Marina Perea-Trigo, и др.
Опубликовано: (2024-02-01)

Face Keypoint Detection Method Based on Blaze_ghost Network
по: Ning Yu, и др.
Опубликовано: (2023-09-01)

Deep Bayesian-Assisted Keypoint Detection for Pose Estimation in Assembly Automation
по: Debo Shi, и др.
Опубликовано: (2023-07-01)

Neural Network Approach for 2-Dimension Person Pose Estimation With Encoded Mask and Keypoint Detection
по: Tahir Rizwan, и др.
Опубликовано: (2020-01-01)

Pose Estimation of Automatic Battery-Replacement System Based on ORB and Improved Keypoints Matching Method
по: Jiabin Jiang, и др.
Опубликовано: (2019-01-01)

An Evaluation on the Robustness of Five Popular Keypoint Descriptors to Image Modifications Specific to Laser Scanning Microscopy
по: Devrim Unay, и др.
Опубликовано: (2018-01-01)

Keypoint Detection for Injury Identification during Turkey Husbandry Using Neural Networks
по: Nina Volkmann, и др.
Опубликовано: (2022-07-01)

Keypoint Detection Based on Curvature Grouping and Adaptive Sampling
по: Bifu Li, и др.
Опубликовано: (2025-01-01)

DSPose: Dual-Space-Driven Keypoint Topology Modeling for Human Pose Estimation
по: Anran Zhao, и др.
Опубликовано: (2023-09-01)

Combining Forces: The South African Sign Language Bible Translation Project
по: van der Walt, Ananda, и др.
Опубликовано: (2021-06-01)

Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection
по: Bowen Zheng, и др.
Опубликовано: (2022-02-01)

Applying a Deep-Learning-Based Keypoint Detection in Analyzing Surface Nanostructures
по: Shaoxuan Yuan, и др.
Опубликовано: (2023-07-01)

An Improved Randomized Local Binary Features for Keypoints Recognition
по: Jinming Zhang, и др.
Опубликовано: (2018-06-01)

Keyframe-Based Camera Relocalization Method Using Landmark and Keypoint Matching
по: Bo Yang, и др.
Опубликовано: (2019-01-01)

Neuroimage signature from salient keypoints is highly specific to individuals and shared by close relatives
по: Laurent Chauvin, и др.
Опубликовано: (2020-01-01)

Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
по: ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong
Опубликовано: (2022-09-01)

SCIENTIFIC ASPECTS OF MODERN APPROACHES TO MACHINE TRANSLATION FOR SIGN LANGUAGE
по: Dana Nurgazina, и др.
Опубликовано: (2024-06-01)

Pose Estimation for Cross-Domain Non-Cooperative Spacecraft Based on Spatial-Aware Keypoints Regression
по: Zihao Wang, и др.
Опубликовано: (2024-11-01)

Keypoint3D: Keypoint-Based and Anchor-Free 3D Object Detection for Autonomous Driving with Monocular Vision
по: Zhen Li, и др.
Опубликовано: (2023-02-01)