Exploring a Novel Mexican Sign Language Lexicon Video Dataset

This research explores a novel Mexican Sign Language (MSL) lexicon video dataset containing the dynamic gestures most frequently used in MSL. Each gesture consists of a set of different versions of videos under uncontrolled conditions. The MX-ITESO-100 dataset is composed of a lexicon of 100 gesture...

Full description

Bibliographic Details
Main Authors: Víctor Martínez-Sánchez, Iván Villalón-Turrubiates, Francisco Cervantes-Álvarez, Carlos Hernández-Mejía
Format: Article
Language:English
Published: MDPI AG 2023-08-01
Series:Multimodal Technologies and Interaction
Subjects:
Online Access:https://www.mdpi.com/2414-4088/7/8/83
_version_ 1797583641090457600
author Víctor Martínez-Sánchez
Iván Villalón-Turrubiates
Francisco Cervantes-Álvarez
Carlos Hernández-Mejía
author_facet Víctor Martínez-Sánchez
Iván Villalón-Turrubiates
Francisco Cervantes-Álvarez
Carlos Hernández-Mejía
author_sort Víctor Martínez-Sánchez
collection DOAJ
description This research explores a novel Mexican Sign Language (MSL) lexicon video dataset containing the dynamic gestures most frequently used in MSL. Each gesture consists of a set of different versions of videos under uncontrolled conditions. The MX-ITESO-100 dataset is composed of a lexicon of 100 gestures and 5000 videos from three participants with different grammatical elements. Additionally, the dataset is evaluated in a two-step neural network model as having an accuracy greater than 99% and thus serves as a benchmark for future training of machine learning models in computer vision systems. Finally, this research provides an inclusive environment within society and organizations, in particular for people with hearing impairments.
first_indexed 2024-03-10T23:41:42Z
format Article
id doaj.art-a9dbab1467bb44fdaf90c4b431d17d7b
institution Directory Open Access Journal
issn 2414-4088
language English
last_indexed 2024-03-10T23:41:42Z
publishDate 2023-08-01
publisher MDPI AG
record_format Article
series Multimodal Technologies and Interaction
spelling doaj.art-a9dbab1467bb44fdaf90c4b431d17d7b2023-11-19T02:26:30ZengMDPI AGMultimodal Technologies and Interaction2414-40882023-08-01788310.3390/mti7080083Exploring a Novel Mexican Sign Language Lexicon Video DatasetVíctor Martínez-Sánchez0Iván Villalón-Turrubiates1Francisco Cervantes-Álvarez2Carlos Hernández-Mejía3Instituto Tecnológico de Estudios Superiores de Occidente (ITESO), Guadalajara 45604, MexicoInstituto Tecnológico de Estudios Superiores de Occidente (ITESO), Guadalajara 45604, MexicoInstituto Tecnológico de Estudios Superiores de Occidente (ITESO), Guadalajara 45604, MexicoTecnológico Nacional de México/ITS de Misantla, Misantla 93850, MexicoThis research explores a novel Mexican Sign Language (MSL) lexicon video dataset containing the dynamic gestures most frequently used in MSL. Each gesture consists of a set of different versions of videos under uncontrolled conditions. The MX-ITESO-100 dataset is composed of a lexicon of 100 gestures and 5000 videos from three participants with different grammatical elements. Additionally, the dataset is evaluated in a two-step neural network model as having an accuracy greater than 99% and thus serves as a benchmark for future training of machine learning models in computer vision systems. Finally, this research provides an inclusive environment within society and organizations, in particular for people with hearing impairments.https://www.mdpi.com/2414-4088/7/8/83Mexican sign languagedatasethand gesturescomputer vision
spellingShingle Víctor Martínez-Sánchez
Iván Villalón-Turrubiates
Francisco Cervantes-Álvarez
Carlos Hernández-Mejía
Exploring a Novel Mexican Sign Language Lexicon Video Dataset
Multimodal Technologies and Interaction
Mexican sign language
dataset
hand gestures
computer vision
title Exploring a Novel Mexican Sign Language Lexicon Video Dataset
title_full Exploring a Novel Mexican Sign Language Lexicon Video Dataset
title_fullStr Exploring a Novel Mexican Sign Language Lexicon Video Dataset
title_full_unstemmed Exploring a Novel Mexican Sign Language Lexicon Video Dataset
title_short Exploring a Novel Mexican Sign Language Lexicon Video Dataset
title_sort exploring a novel mexican sign language lexicon video dataset
topic Mexican sign language
dataset
hand gestures
computer vision
url https://www.mdpi.com/2414-4088/7/8/83
work_keys_str_mv AT victormartinezsanchez exploringanovelmexicansignlanguagelexiconvideodataset
AT ivanvillalonturrubiates exploringanovelmexicansignlanguagelexiconvideodataset
AT franciscocervantesalvarez exploringanovelmexicansignlanguagelexiconvideodataset
AT carloshernandezmejia exploringanovelmexicansignlanguagelexiconvideodataset