Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage Survey

Mass gatherings (such as Hajj/Umrah), owing to their immensity, often present a variety of difficulties to the attendees. To have a comprehensive understanding of the difficulties as well as their potential remedies, surveying a good number of attendees is unavoidable and this can be facilitated thr...

Full description

Bibliographic Details
Main Authors: Saiful Islam Salim, Najla Abdulrahman Al-Nabhan, Masfiqur Rahaman, Nafisa Islam, Tarik Reza Toha, Jannatun Noor, Adnan Quaium, Aaiyeesha Mostak, Mainul Hossain, Md. Masum Mushfiq, A. B. M. Alim Al Islam
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9508367/
_version_ 1818363058243764224
author Saiful Islam Salim
Najla Abdulrahman Al-Nabhan
Masfiqur Rahaman
Nafisa Islam
Tarik Reza Toha
Jannatun Noor
Adnan Quaium
Aaiyeesha Mostak
Mainul Hossain
Md. Masum Mushfiq
A. B. M. Alim Al Islam
author_facet Saiful Islam Salim
Najla Abdulrahman Al-Nabhan
Masfiqur Rahaman
Nafisa Islam
Tarik Reza Toha
Jannatun Noor
Adnan Quaium
Aaiyeesha Mostak
Mainul Hossain
Md. Masum Mushfiq
A. B. M. Alim Al Islam
author_sort Saiful Islam Salim
collection DOAJ
description Mass gatherings (such as Hajj/Umrah), owing to their immensity, often present a variety of difficulties to the attendees. To have a comprehensive understanding of the difficulties as well as their potential remedies, surveying a good number of attendees is unavoidable and this can be facilitated through engaging data collectors. A crucial part here is identifying the integrity of the data collectors, which is yet to be explored in the literature to the best of our knowledge. To address this gap, in this study, we first perform a mass-scale data collection over Hajj/Umrah pilgrims through online (n = 236) and in-person (n = 752) surveys, where we cover a substantial part (n = 712) through paid data collectors (n = 53). We critically investigate data collection activities of the data collectors through focused group discussions involving expert reviewers. We explore two computing techniques to unveil the integrity of the data collectors from two different perspectives. Our study finds out influential (religious and socio-geographical) aspects that impact the data collection process. Besides, we find that the collaborative participation of expert reviewers is obligatory to scrutinize the data collectors’ integrity. Additionally, our explored computing techniques, namely conflict analysis and learning-based analysis, can identify up to 74% and 99% of the unreliable data collectors respectively. We observe that, although these computing-based filtering can indicate the integrity up to a certain level, human-in-the-loop is unavoidable for concluding on the integrity. To the best of our knowledge, this is the first study of its kind (i.e., integrity analysis of the data collectors) in the literature.
first_indexed 2024-12-13T21:42:26Z
format Article
id doaj.art-f38cc3a32ed441e98abb239381e954d2
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-13T21:42:26Z
publishDate 2021-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-f38cc3a32ed441e98abb239381e954d22022-12-21T23:30:31ZengIEEEIEEE Access2169-35362021-01-01911252811255110.1109/ACCESS.2021.31030469508367Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage SurveySaiful Islam Salim0https://orcid.org/0000-0002-4464-2203Najla Abdulrahman Al-Nabhan1https://orcid.org/0000-0002-0805-1721Masfiqur Rahaman2https://orcid.org/0000-0001-8647-6189Nafisa Islam3https://orcid.org/0000-0001-7784-5480Tarik Reza Toha4https://orcid.org/0000-0002-6529-3487Jannatun Noor5https://orcid.org/0000-0001-9669-151XAdnan Quaium6https://orcid.org/0000-0003-1108-1734Aaiyeesha Mostak7Mainul Hossain8https://orcid.org/0000-0003-3462-2660Md. Masum Mushfiq9https://orcid.org/0000-0003-0306-1485A. B. M. Alim Al Islam10https://orcid.org/0000-0001-8159-6114Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science, King Saud University, Riyad, Saudi ArabiaDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Civil Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshDepartment of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, BangladeshMass gatherings (such as Hajj/Umrah), owing to their immensity, often present a variety of difficulties to the attendees. To have a comprehensive understanding of the difficulties as well as their potential remedies, surveying a good number of attendees is unavoidable and this can be facilitated through engaging data collectors. A crucial part here is identifying the integrity of the data collectors, which is yet to be explored in the literature to the best of our knowledge. To address this gap, in this study, we first perform a mass-scale data collection over Hajj/Umrah pilgrims through online (n = 236) and in-person (n = 752) surveys, where we cover a substantial part (n = 712) through paid data collectors (n = 53). We critically investigate data collection activities of the data collectors through focused group discussions involving expert reviewers. We explore two computing techniques to unveil the integrity of the data collectors from two different perspectives. Our study finds out influential (religious and socio-geographical) aspects that impact the data collection process. Besides, we find that the collaborative participation of expert reviewers is obligatory to scrutinize the data collectors’ integrity. Additionally, our explored computing techniques, namely conflict analysis and learning-based analysis, can identify up to 74% and 99% of the unreliable data collectors respectively. We observe that, although these computing-based filtering can indicate the integrity up to a certain level, human-in-the-loop is unavoidable for concluding on the integrity. To the best of our knowledge, this is the first study of its kind (i.e., integrity analysis of the data collectors) in the literature.https://ieeexplore.ieee.org/document/9508367/Collaborative filteringreligious congregationsocial computingempirical investigationsdata collector integrityreliability
spellingShingle Saiful Islam Salim
Najla Abdulrahman Al-Nabhan
Masfiqur Rahaman
Nafisa Islam
Tarik Reza Toha
Jannatun Noor
Adnan Quaium
Aaiyeesha Mostak
Mainul Hossain
Md. Masum Mushfiq
A. B. M. Alim Al Islam
Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage Survey
IEEE Access
Collaborative filtering
religious congregation
social computing
empirical investigations
data collector integrity
reliability
title Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage Survey
title_full Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage Survey
title_fullStr Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage Survey
title_full_unstemmed Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage Survey
title_short Human-Survey Interaction (HSI): A Study on Integrity of Human Data Collectors in a Mass-Scale Hajj Pilgrimage Survey
title_sort human survey interaction hsi a study on integrity of human data collectors in a mass scale hajj pilgrimage survey
topic Collaborative filtering
religious congregation
social computing
empirical investigations
data collector integrity
reliability
url https://ieeexplore.ieee.org/document/9508367/
work_keys_str_mv AT saifulislamsalim humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT najlaabdulrahmanalnabhan humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT masfiqurrahaman humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT nafisaislam humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT tarikrezatoha humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT jannatunnoor humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT adnanquaium humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT aaiyeeshamostak humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT mainulhossain humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT mdmasummushfiq humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey
AT abmalimalislam humansurveyinteractionhsiastudyonintegrityofhumandatacollectorsinamassscalehajjpilgrimagesurvey