ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display

We present ARTYCUL (ARTifact popularitY for CULtural heritage), a machine learning(ML)-based framework that graphically represents the footfall around an artifact on display at a museum or a heritage site. The driving factor of this framework was the fact that the presence of security cameras has be...

Full description

Bibliographic Details
Main Authors: Gatha Varma, Ritu Chauhan, Eiad Yafi
Format: Article
Language:English
Published: MDPI AG 2021-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/4/1527
_version_ 1797395563405115392
author Gatha Varma
Ritu Chauhan
Eiad Yafi
author_facet Gatha Varma
Ritu Chauhan
Eiad Yafi
author_sort Gatha Varma
collection DOAJ
description We present ARTYCUL (ARTifact popularitY for CULtural heritage), a machine learning(ML)-based framework that graphically represents the footfall around an artifact on display at a museum or a heritage site. The driving factor of this framework was the fact that the presence of security cameras has become universal, including at sites of cultural heritage. ARTYCUL used the video streams of closed-circuit televisions (CCTV) cameras installed in such premises to detect human figures, and their coordinates with respect to the camera frames were used to visualize the density of visitors around the specific display items. Such a framework that can display the popularity of artifacts would aid the curators towards a more optimal organization. Moreover, it could also help to gauge if a certain display item were neglected due to incorrect placement. While items of similar interest can be placed in vicinity of each other, an online recommendation system may also use the reputation of an artifact to catch the eye of the visitors. Artificial intelligence-based solutions are well suited for analysis of internet of things (IoT) traffic due to the inherent veracity and volatile nature of the transmissions. The work done for the development of ARTYCUL provided a deeper insight into the avenues for applications of IoT technology to the cultural heritage domain, and suitability of ML to process real-time data at a fast pace. While we also observed common issues that hinder the utilization of IoT in the cultural domain, the proposed framework was designed keeping in mind the same obstacles and a preference for backward compatibility.
first_indexed 2024-03-09T00:37:20Z
format Article
id doaj.art-44bd9912f24649feaf832f6156fd14b5
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T00:37:20Z
publishDate 2021-02-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-44bd9912f24649feaf832f6156fd14b52023-12-11T18:02:50ZengMDPI AGSensors1424-82202021-02-01214152710.3390/s21041527ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on DisplayGatha Varma0Ritu Chauhan1Eiad Yafi2Amity Institute of Information Technology, Amity University, Noida 201313, IndiaCenter for Computational Biology and Bioinformatics, Amity University, Noida 201313, IndiaMalaysian Institute of Information Technology, Universiti Kuala Lumpur, Kuala Lumpur 50250, MalaysiaWe present ARTYCUL (ARTifact popularitY for CULtural heritage), a machine learning(ML)-based framework that graphically represents the footfall around an artifact on display at a museum or a heritage site. The driving factor of this framework was the fact that the presence of security cameras has become universal, including at sites of cultural heritage. ARTYCUL used the video streams of closed-circuit televisions (CCTV) cameras installed in such premises to detect human figures, and their coordinates with respect to the camera frames were used to visualize the density of visitors around the specific display items. Such a framework that can display the popularity of artifacts would aid the curators towards a more optimal organization. Moreover, it could also help to gauge if a certain display item were neglected due to incorrect placement. While items of similar interest can be placed in vicinity of each other, an online recommendation system may also use the reputation of an artifact to catch the eye of the visitors. Artificial intelligence-based solutions are well suited for analysis of internet of things (IoT) traffic due to the inherent veracity and volatile nature of the transmissions. The work done for the development of ARTYCUL provided a deeper insight into the avenues for applications of IoT technology to the cultural heritage domain, and suitability of ML to process real-time data at a fast pace. While we also observed common issues that hinder the utilization of IoT in the cultural domain, the proposed framework was designed keeping in mind the same obstacles and a preference for backward compatibility.https://www.mdpi.com/1424-8220/21/4/1527internet of things (IoT)cultural heritageartifact reputationhistogram of oriented gradient (HOG)clusteringhuman detection
spellingShingle Gatha Varma
Ritu Chauhan
Eiad Yafi
ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display
Sensors
internet of things (IoT)
cultural heritage
artifact reputation
histogram of oriented gradient (HOG)
clustering
human detection
title ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display
title_full ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display
title_fullStr ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display
title_full_unstemmed ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display
title_short ARTYCUL: A Privacy-Preserving ML-Driven Framework to Determine the Popularity of a Cultural Exhibit on Display
title_sort artycul a privacy preserving ml driven framework to determine the popularity of a cultural exhibit on display
topic internet of things (IoT)
cultural heritage
artifact reputation
histogram of oriented gradient (HOG)
clustering
human detection
url https://www.mdpi.com/1424-8220/21/4/1527
work_keys_str_mv AT gathavarma artyculaprivacypreservingmldrivenframeworktodeterminethepopularityofaculturalexhibitondisplay
AT rituchauhan artyculaprivacypreservingmldrivenframeworktodeterminethepopularityofaculturalexhibitondisplay
AT eiadyafi artyculaprivacypreservingmldrivenframeworktodeterminethepopularityofaculturalexhibitondisplay