Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research Directions

Over the past few decades, the enormous expansion of medical data has led to searching for ways of data analysis in smart healthcare systems. Acquisition of data from pictures, archives, communication systems, electronic health records, online documents, radiology reports and clinical records of dif...

Full description

Bibliographic Details
Main Authors: Shashank Shetty, Ananthanarayana V S, Ajit Mahale
Format: Article
Language:ces
Published: Prague University of Economics and Business 2022-12-01
Series:Acta Informatica Pragensia
Subjects:
Online Access:https://aip.vse.cz/artkey/aip-202203-0009_comprehensive-review-of-multimodal-medical-data-analysis-open-issues-and-future-research-directions.php
_version_ 1797861450584162304
author Shashank Shetty
Ananthanarayana V S
Ajit Mahale
author_facet Shashank Shetty
Ananthanarayana V S
Ajit Mahale
author_sort Shashank Shetty
collection DOAJ
description Over the past few decades, the enormous expansion of medical data has led to searching for ways of data analysis in smart healthcare systems. Acquisition of data from pictures, archives, communication systems, electronic health records, online documents, radiology reports and clinical records of different styles with specific numerical information has given rise to the concept of multimodality and the need for machine learning and deep learning techniques in the analysis of the healthcare system. Medical data play a vital role in medical education and diagnosis; determining dependency between distinct modalities is essential. This paper gives a gist of current radiology medical data analysis techniques and their various approaches and frameworks for representation and classification. A brief outline of the existing medical multimodal data processing work is presented. The main objective of this study is to spot gaps in the surveyed area and list future tasks and challenges in radiology. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (or PRISMA) guidelines were incorporated in this study for effective article search and to investigate several relevant scientific publications. The systematic review was carried out on multimodal medical data analysis and highlighted advantages, limitations and strategies. The inherent benefit of multimodality in the medical domain powered with artificial intelligence has a significant impact on the performance of the disease diagnosis frameworks.
first_indexed 2024-04-09T22:02:40Z
format Article
id doaj.art-e6876afdbf3f49b68bba0471624d0cec
institution Directory Open Access Journal
issn 1805-4951
language ces
last_indexed 2024-04-09T22:02:40Z
publishDate 2022-12-01
publisher Prague University of Economics and Business
record_format Article
series Acta Informatica Pragensia
spelling doaj.art-e6876afdbf3f49b68bba0471624d0cec2023-03-23T14:16:15ZcesPrague University of Economics and BusinessActa Informatica Pragensia1805-49512022-12-0111342345710.18267/j.aip.202aip-202203-0009Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research DirectionsShashank Shetty0Ananthanarayana V S1Ajit Mahale2Department of Information Technology, National Institute of Technology Karnataka, Mangalore-575025, Karnataka, IndiaDepartment of Information Technology, National Institute of Technology Karnataka, Mangalore-575025, Karnataka, IndiaDepartment of Radiology, Kasturba Medical College, Mangalore, Manipal Academy of Higher Education, Manipal-575001, IndiaOver the past few decades, the enormous expansion of medical data has led to searching for ways of data analysis in smart healthcare systems. Acquisition of data from pictures, archives, communication systems, electronic health records, online documents, radiology reports and clinical records of different styles with specific numerical information has given rise to the concept of multimodality and the need for machine learning and deep learning techniques in the analysis of the healthcare system. Medical data play a vital role in medical education and diagnosis; determining dependency between distinct modalities is essential. This paper gives a gist of current radiology medical data analysis techniques and their various approaches and frameworks for representation and classification. A brief outline of the existing medical multimodal data processing work is presented. The main objective of this study is to spot gaps in the surveyed area and list future tasks and challenges in radiology. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (or PRISMA) guidelines were incorporated in this study for effective article search and to investigate several relevant scientific publications. The systematic review was carried out on multimodal medical data analysis and highlighted advantages, limitations and strategies. The inherent benefit of multimodality in the medical domain powered with artificial intelligence has a significant impact on the performance of the disease diagnosis frameworks.https://aip.vse.cz/artkey/aip-202203-0009_comprehensive-review-of-multimodal-medical-data-analysis-open-issues-and-future-research-directions.phpaibig data analysisclinical recommendation systemmultimodalitystructured and unstructured healthcare datadata extractiondata classificationdata visualization
spellingShingle Shashank Shetty
Ananthanarayana V S
Ajit Mahale
Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research Directions
Acta Informatica Pragensia
ai
big data analysis
clinical recommendation system
multimodality
structured and unstructured healthcare data
data extraction
data classification
data visualization
title Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research Directions
title_full Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research Directions
title_fullStr Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research Directions
title_full_unstemmed Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research Directions
title_short Comprehensive Review of Multimodal Medical Data Analysis: Open Issues and Future Research Directions
title_sort comprehensive review of multimodal medical data analysis open issues and future research directions
topic ai
big data analysis
clinical recommendation system
multimodality
structured and unstructured healthcare data
data extraction
data classification
data visualization
url https://aip.vse.cz/artkey/aip-202203-0009_comprehensive-review-of-multimodal-medical-data-analysis-open-issues-and-future-research-directions.php
work_keys_str_mv AT shashankshetty comprehensivereviewofmultimodalmedicaldataanalysisopenissuesandfutureresearchdirections
AT ananthanarayanavs comprehensivereviewofmultimodalmedicaldataanalysisopenissuesandfutureresearchdirections
AT ajitmahale comprehensivereviewofmultimodalmedicaldataanalysisopenissuesandfutureresearchdirections