Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive Review

Body language refers to the unspoken communication conveyed through human body actions like body movements and postures, limb gestures, and facial and other bodily expressions. It acts as a transparent medium, exposing an individual’s emotions, attitudes, true thoughts, intentions, and ph...

Full description

Bibliographic Details
Main Authors: Sherzod Turaev, Aiswarya Babu, Saja Al-Dabet, Jaloliddin Rustamov, Zahiriddin Rustamov, Nazar Zaki, Mohd Saberi Mohamad, Chu Kiong Loo
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10414040/
_version_ 1797323912097300480
author Sherzod Turaev
Aiswarya Babu
Saja Al-Dabet
Jaloliddin Rustamov
Zahiriddin Rustamov
Nazar Zaki
Mohd Saberi Mohamad
Chu Kiong Loo
author_facet Sherzod Turaev
Aiswarya Babu
Saja Al-Dabet
Jaloliddin Rustamov
Zahiriddin Rustamov
Nazar Zaki
Mohd Saberi Mohamad
Chu Kiong Loo
author_sort Sherzod Turaev
collection DOAJ
description Body language refers to the unspoken communication conveyed through human body actions like body movements and postures, limb gestures, and facial and other bodily expressions. It acts as a transparent medium, exposing an individual’s emotions, attitudes, true thoughts, intentions, and physical and mental health states. A person may express pain using hand movements or other bodily cues, their facial expressions potentially offering insights into the intensity of the pain. Additionally, various diseases and pains can induce abnormalities in body movements, postures, and expressions, signaling distress or discomfort. Therefore, investigating the cause-effect relationships between diseases/pains and patients’ abnormal body language holds significant relevance, promising to enhance our understanding and management of these conditions. This importance has been reflected in numerous healthcare and artificial intelligence (AI) research articles. AI studies investigate this and related topics by detecting, recognizing, and analyzing patients’ abnormal activities and body actions using machine-learning techniques. However, most AI studies do not consider comprehensive domain knowledge that describes a complete and accurate list of patients’ abnormal actions caused by a disease or pain. Though these results appear consistent and stable from an AI outlook, they fall short when viewed through the prism of healthcare, primarily because the limited domain knowledge incorporated in the AI studies makes the findings partially incomplete. To overcome these drawbacks, this paper comprehensively reviews healthcare and medical studies centered on patients’ body language from an AI outlook. It presents a thorough descriptive and exploratory analysis of the findings, yielding a more accurate and comprehensive understanding of the causational connections between diseases and abnormal body actions and the strength of the evidence supporting these connections. The analysis enables us to define “disease-to-abnormality” and “abnormality-to-disease” mappings that result in building exhaustive and accurate lists of abnormal body actions induced by diseases and pains as well as lists of diseases and pains causing particular abnormal body actions. The generation of these lists is assisted by the concepts of “correlation strength index” and “strongly correlated selection” defined in this paper. The paper’s results have significant implications for developing machine learning systems that can more accurately analyze patients’ physical and mental health states, correctly identify external signs and symptoms of diseases, and effectively monitor health conditions.
first_indexed 2024-03-08T05:34:56Z
format Article
id doaj.art-5b5721486f4b4ce68e3dfb0b8627a48b
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-08T05:34:56Z
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-5b5721486f4b4ce68e3dfb0b8627a48b2024-02-06T00:01:29ZengIEEEIEEE Access2169-35362024-01-0112165141654810.1109/ACCESS.2024.335839810414040Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive ReviewSherzod Turaev0https://orcid.org/0000-0001-6661-8469Aiswarya Babu1https://orcid.org/0009-0004-8164-1957Saja Al-Dabet2https://orcid.org/0000-0003-4374-8062Jaloliddin Rustamov3Zahiriddin Rustamov4https://orcid.org/0000-0003-4977-1781Nazar Zaki5https://orcid.org/0000-0002-6259-9843Mohd Saberi Mohamad6https://orcid.org/0000-0002-1079-4559Chu Kiong Loo7https://orcid.org/0000-0001-7867-2665College of Information Technology, United Arab Emirates University, Al Ain, United Arab EmiratesCollege of Information Technology, United Arab Emirates University, Al Ain, United Arab EmiratesCollege of Information Technology, United Arab Emirates University, Al Ain, United Arab EmiratesCollege of Information Technology, United Arab Emirates University, Al Ain, United Arab EmiratesCollege of Information Technology, United Arab Emirates University, Al Ain, United Arab EmiratesCollege of Information Technology, United Arab Emirates University, Al Ain, United Arab EmiratesDepartment of Genetics and Genomics, College of Medicine and Health Sciences, Health Data Science Laboratory, United Arab Emirates University, Al Ain, United Arab EmiratesDepartment of Artificial Intelligence, Faculty of Computer Science and Information Technology, University of Malaya, Kuala Lumpur, MalaysiaBody language refers to the unspoken communication conveyed through human body actions like body movements and postures, limb gestures, and facial and other bodily expressions. It acts as a transparent medium, exposing an individual’s emotions, attitudes, true thoughts, intentions, and physical and mental health states. A person may express pain using hand movements or other bodily cues, their facial expressions potentially offering insights into the intensity of the pain. Additionally, various diseases and pains can induce abnormalities in body movements, postures, and expressions, signaling distress or discomfort. Therefore, investigating the cause-effect relationships between diseases/pains and patients’ abnormal body language holds significant relevance, promising to enhance our understanding and management of these conditions. This importance has been reflected in numerous healthcare and artificial intelligence (AI) research articles. AI studies investigate this and related topics by detecting, recognizing, and analyzing patients’ abnormal activities and body actions using machine-learning techniques. However, most AI studies do not consider comprehensive domain knowledge that describes a complete and accurate list of patients’ abnormal actions caused by a disease or pain. Though these results appear consistent and stable from an AI outlook, they fall short when viewed through the prism of healthcare, primarily because the limited domain knowledge incorporated in the AI studies makes the findings partially incomplete. To overcome these drawbacks, this paper comprehensively reviews healthcare and medical studies centered on patients’ body language from an AI outlook. It presents a thorough descriptive and exploratory analysis of the findings, yielding a more accurate and comprehensive understanding of the causational connections between diseases and abnormal body actions and the strength of the evidence supporting these connections. The analysis enables us to define “disease-to-abnormality” and “abnormality-to-disease” mappings that result in building exhaustive and accurate lists of abnormal body actions induced by diseases and pains as well as lists of diseases and pains causing particular abnormal body actions. The generation of these lists is assisted by the concepts of “correlation strength index” and “strongly correlated selection” defined in this paper. The paper’s results have significant implications for developing machine learning systems that can more accurately analyze patients’ physical and mental health states, correctly identify external signs and symptoms of diseases, and effectively monitor health conditions.https://ieeexplore.ieee.org/document/10414040/Body languagediseasepainbody movementbody posturefacial expression
spellingShingle Sherzod Turaev
Aiswarya Babu
Saja Al-Dabet
Jaloliddin Rustamov
Zahiriddin Rustamov
Nazar Zaki
Mohd Saberi Mohamad
Chu Kiong Loo
Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive Review
IEEE Access
Body language
disease
pain
body movement
body posture
facial expression
title Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive Review
title_full Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive Review
title_fullStr Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive Review
title_full_unstemmed Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive Review
title_short Data-Driven Analysis of Patients’ Body Language in Healthcare: A Comprehensive Review
title_sort data driven analysis of patients x2019 body language in healthcare a comprehensive review
topic Body language
disease
pain
body movement
body posture
facial expression
url https://ieeexplore.ieee.org/document/10414040/
work_keys_str_mv AT sherzodturaev datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview
AT aiswaryababu datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview
AT sajaaldabet datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview
AT jaloliddinrustamov datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview
AT zahiriddinrustamov datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview
AT nazarzaki datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview
AT mohdsaberimohamad datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview
AT chukiongloo datadrivenanalysisofpatientsx2019bodylanguageinhealthcareacomprehensivereview