Smart Multimedia Information Retrieval

The area of multimedia information retrieval (MMIR) faces two major challenges: the enormously growing number of multimedia objects (i.e., images, videos, audio, and text files), and the fast increasing level of detail of these objects (e.g., the number of pixels in images). Both challenges lead to...

Full description

Bibliographic Details
Main Authors: Stefan Wagenpfeil, Paul Mc Kevitt, Matthias Hemmje
Format: Article
Language:English
Published: MDPI AG 2023-02-01
Series:Analytics
Subjects:
Online Access:https://www.mdpi.com/2813-2203/2/1/11
_version_ 1797613962581245952
author Stefan Wagenpfeil
Paul Mc Kevitt
Matthias Hemmje
author_facet Stefan Wagenpfeil
Paul Mc Kevitt
Matthias Hemmje
author_sort Stefan Wagenpfeil
collection DOAJ
description The area of multimedia information retrieval (MMIR) faces two major challenges: the enormously growing number of multimedia objects (i.e., images, videos, audio, and text files), and the fast increasing level of detail of these objects (e.g., the number of pixels in images). Both challenges lead to a high demand of scalability, semantic representations, and explainability of MMIR processes. Smart MMIR solves these challenges by employing graph codes as an indexing structure, attaching semantic annotations for explainability, and employing application profiling for scaling, which results in human-understandable, expressive, and interoperable MMIR. The mathematical foundation, the modeling, implementation detail, and experimental results are shown in this paper, which confirm that Smart MMIR improves MMIR in the area of efficiency, effectiveness, and human understandability.
first_indexed 2024-03-11T07:02:56Z
format Article
id doaj.art-d64c0248225b4549826271eec3961f83
institution Directory Open Access Journal
issn 2813-2203
language English
last_indexed 2024-03-11T07:02:56Z
publishDate 2023-02-01
publisher MDPI AG
record_format Article
series Analytics
spelling doaj.art-d64c0248225b4549826271eec3961f832023-11-17T09:10:01ZengMDPI AGAnalytics2813-22032023-02-012119822410.3390/analytics2010011Smart Multimedia Information RetrievalStefan Wagenpfeil0Paul Mc Kevitt1Matthias Hemmje2Faculty of Mathematics and Computer Science, University of Hagen, Universitätsstrasse 1, D-58097 Hagen, GermanyAcademy for International Science & Research (AISR), Derry BT48 7JL, Northern Ireland, UKFaculty of Mathematics and Computer Science, University of Hagen, Universitätsstrasse 1, D-58097 Hagen, GermanyThe area of multimedia information retrieval (MMIR) faces two major challenges: the enormously growing number of multimedia objects (i.e., images, videos, audio, and text files), and the fast increasing level of detail of these objects (e.g., the number of pixels in images). Both challenges lead to a high demand of scalability, semantic representations, and explainability of MMIR processes. Smart MMIR solves these challenges by employing graph codes as an indexing structure, attaching semantic annotations for explainability, and employing application profiling for scaling, which results in human-understandable, expressive, and interoperable MMIR. The mathematical foundation, the modeling, implementation detail, and experimental results are shown in this paper, which confirm that Smart MMIR improves MMIR in the area of efficiency, effectiveness, and human understandability.https://www.mdpi.com/2813-2203/2/1/11indexingretrievalexplainabilitysemanticmultimediafeature graph
spellingShingle Stefan Wagenpfeil
Paul Mc Kevitt
Matthias Hemmje
Smart Multimedia Information Retrieval
Analytics
indexing
retrieval
explainability
semantic
multimedia
feature graph
title Smart Multimedia Information Retrieval
title_full Smart Multimedia Information Retrieval
title_fullStr Smart Multimedia Information Retrieval
title_full_unstemmed Smart Multimedia Information Retrieval
title_short Smart Multimedia Information Retrieval
title_sort smart multimedia information retrieval
topic indexing
retrieval
explainability
semantic
multimedia
feature graph
url https://www.mdpi.com/2813-2203/2/1/11
work_keys_str_mv AT stefanwagenpfeil smartmultimediainformationretrieval
AT paulmckevitt smartmultimediainformationretrieval
AT matthiashemmje smartmultimediainformationretrieval