Analysis of performance between kinect v1 and kinect v2 for various facial part movements

The aim of this study is to determine the suitable version of Kinect motion sensor for developing facial therapy or exercise throughout the analysis of face tracking performance. A face tracking system is developed in both version of Kinect cameras by referring to the respective version of Kinect SD...

Full description

Bibliographic Details
Main Authors: Heng, Sheng Guang, Rosdiyana, Samad, Mahfuzah, Mustafa, Nor Rul Hasma, Abdullah, Pebrianti, Dwi
Format: Conference or Workshop Item
Language:English
Published: IEEE 2019
Subjects:
Online Access:http://umpir.ump.edu.my/id/eprint/29730/1/Analysis%20of%20performance%20between%20kinect%20v1%20and%20kinect%20v2%20.pdf
_version_ 1796994300216606720
author Heng, Sheng Guang
Rosdiyana, Samad
Mahfuzah, Mustafa
Nor Rul Hasma, Abdullah
Pebrianti, Dwi
author_facet Heng, Sheng Guang
Rosdiyana, Samad
Mahfuzah, Mustafa
Nor Rul Hasma, Abdullah
Pebrianti, Dwi
author_sort Heng, Sheng Guang
collection UMP
description The aim of this study is to determine the suitable version of Kinect motion sensor for developing facial therapy or exercise throughout the analysis of face tracking performance. A face tracking system is developed in both version of Kinect cameras by referring to the respective version of Kinect SDK. The created face tracking algorithms are then modified to display the detected facial points which are 121 points and 1347 points in total for Kinect v1 and Kinect v2 respectively. A total number of 18 desired facial feature point at similar landmarks will be extracted in the format of 3D coordinates for both Kinect cameras. To investigate the changes in the movement of facial feature points, the points will be paired up for distance ratio calculation between different frames of face image. The action unit of facial points for both Kinect cameras are different and there are some improvements in Kinect v2: asymmetrical facial points, high definition face detection and eye tracking as added action units. However, it shows poor detection in outer eyebrow part compared to Kinect v1. In overall, the Kinect v2 has better performance than Kinect v1 as it provides faster response speed and more detailed facial points movement detection in real-time operation for rehabilitation purposes.
first_indexed 2024-03-06T12:45:56Z
format Conference or Workshop Item
id UMPir29730
institution Universiti Malaysia Pahang
language English
last_indexed 2024-03-06T12:45:56Z
publishDate 2019
publisher IEEE
record_format dspace
spelling UMPir297302020-11-19T01:25:47Z http://umpir.ump.edu.my/id/eprint/29730/ Analysis of performance between kinect v1 and kinect v2 for various facial part movements Heng, Sheng Guang Rosdiyana, Samad Mahfuzah, Mustafa Nor Rul Hasma, Abdullah Pebrianti, Dwi TK Electrical engineering. Electronics Nuclear engineering The aim of this study is to determine the suitable version of Kinect motion sensor for developing facial therapy or exercise throughout the analysis of face tracking performance. A face tracking system is developed in both version of Kinect cameras by referring to the respective version of Kinect SDK. The created face tracking algorithms are then modified to display the detected facial points which are 121 points and 1347 points in total for Kinect v1 and Kinect v2 respectively. A total number of 18 desired facial feature point at similar landmarks will be extracted in the format of 3D coordinates for both Kinect cameras. To investigate the changes in the movement of facial feature points, the points will be paired up for distance ratio calculation between different frames of face image. The action unit of facial points for both Kinect cameras are different and there are some improvements in Kinect v2: asymmetrical facial points, high definition face detection and eye tracking as added action units. However, it shows poor detection in outer eyebrow part compared to Kinect v1. In overall, the Kinect v2 has better performance than Kinect v1 as it provides faster response speed and more detailed facial points movement detection in real-time operation for rehabilitation purposes. IEEE 2019-10 Conference or Workshop Item PeerReviewed pdf en http://umpir.ump.edu.my/id/eprint/29730/1/Analysis%20of%20performance%20between%20kinect%20v1%20and%20kinect%20v2%20.pdf Heng, Sheng Guang and Rosdiyana, Samad and Mahfuzah, Mustafa and Nor Rul Hasma, Abdullah and Pebrianti, Dwi (2019) Analysis of performance between kinect v1 and kinect v2 for various facial part movements. In: 9th IEEE International Conference on System Engineering and Technology, ICSET 2019 , 7 October 2019 , Shah Alam, Malaysia. pp. 17-22. (8906419). ISSN 2470-640X ISBN 9781728107585 https://doi.org/10.1109/ICSEngT.2019.8906419
spellingShingle TK Electrical engineering. Electronics Nuclear engineering
Heng, Sheng Guang
Rosdiyana, Samad
Mahfuzah, Mustafa
Nor Rul Hasma, Abdullah
Pebrianti, Dwi
Analysis of performance between kinect v1 and kinect v2 for various facial part movements
title Analysis of performance between kinect v1 and kinect v2 for various facial part movements
title_full Analysis of performance between kinect v1 and kinect v2 for various facial part movements
title_fullStr Analysis of performance between kinect v1 and kinect v2 for various facial part movements
title_full_unstemmed Analysis of performance between kinect v1 and kinect v2 for various facial part movements
title_short Analysis of performance between kinect v1 and kinect v2 for various facial part movements
title_sort analysis of performance between kinect v1 and kinect v2 for various facial part movements
topic TK Electrical engineering. Electronics Nuclear engineering
url http://umpir.ump.edu.my/id/eprint/29730/1/Analysis%20of%20performance%20between%20kinect%20v1%20and%20kinect%20v2%20.pdf
work_keys_str_mv AT hengshengguang analysisofperformancebetweenkinectv1andkinectv2forvariousfacialpartmovements
AT rosdiyanasamad analysisofperformancebetweenkinectv1andkinectv2forvariousfacialpartmovements
AT mahfuzahmustafa analysisofperformancebetweenkinectv1andkinectv2forvariousfacialpartmovements
AT norrulhasmaabdullah analysisofperformancebetweenkinectv1andkinectv2forvariousfacialpartmovements
AT pebriantidwi analysisofperformancebetweenkinectv1andkinectv2forvariousfacialpartmovements