Validation of a COVID-19 mental health and wellness survey questionnaire

Abstract Background and aim COVID-19 affected mental health and wellbeing. Research is needed to assess its impact using validated tools. The study assessed the content validity, reliability and dimensionality of a multidimensional tool for assessing the mental health and wellbeing of adults. Method...

Full description

Bibliographic Details
Main Authors: Maha El Tantawi, Morenike Oluwatoyin Folayan, Annie Lu Nguyen, Nourhan M. Aly, Oliver Ezechi, Benjamin S. C. Uzochukwu, Oluwatoyin Adedoyin Alaba, Brandon Brown
Format: Article
Language:English
Published: BMC 2022-08-01
Series:BMC Public Health
Subjects:
Online Access:https://doi.org/10.1186/s12889-022-13825-2
_version_ 1811320893975035904
author Maha El Tantawi
Morenike Oluwatoyin Folayan
Annie Lu Nguyen
Nourhan M. Aly
Oliver Ezechi
Benjamin S. C. Uzochukwu
Oluwatoyin Adedoyin Alaba
Brandon Brown
author_facet Maha El Tantawi
Morenike Oluwatoyin Folayan
Annie Lu Nguyen
Nourhan M. Aly
Oliver Ezechi
Benjamin S. C. Uzochukwu
Oluwatoyin Adedoyin Alaba
Brandon Brown
author_sort Maha El Tantawi
collection DOAJ
description Abstract Background and aim COVID-19 affected mental health and wellbeing. Research is needed to assess its impact using validated tools. The study assessed the content validity, reliability and dimensionality of a multidimensional tool for assessing the mental health and wellbeing of adults. Methods An online questionnaire collected data in the second half of 2020 from adults in different countries. The questionnaire included nine sections assessing: COVID-19 experience and sociodemographic profile; health and memory; pandemic stress (pandemic stress index, PSI); financial and lifestyle impact; social support; post-traumatic stress disorder (PTSD); coping strategies; self-care and HIV profile over 57 questions. Content validity was assessed (content validity index, CVI) and participants evaluated the test-retest reliability (Kappa statistic and intra-class correlation coefficient, ICC). Internal consistency of scales was assessed (Cronbach α). The dimensionality of the PSI sections and self-care strategies was assessed by multiple correspondence analysis (MCA) using all responses and SPSS. For qualitative validation, we used a semi-structured interview and NVivo was used for coding and thematic analysis. Results The overall CVI = 0.83 with lower values for the memory items. Cronbach α for the memory items = 0.94 and ICC = 0.71. Cronbach α for PTSD items was 0.93 and ICC = 0.89. Test-retest scores varied by section. The 2-dimensions solution of MCA for the PSI behavior section explained 33.6% (precautionary measures dimension), 11.4% (response to impact dimension) and overall variance = 45%. The 2-dimensions of the PSI psychosocial impact explained 23.5% (psychosocial impact of the pandemic dimension), 8.3% (psychosocial impact of the precautionary measures of the pandemic dimension) and overall variance = 31.8%. The 2-dimensions of self-care explained 32.9% (dimension of self-care strategies by people who prefer to stay at home and avoid others), 9% (dimension of self-care strategies by outward-going people) and overall variance = 41.9%. Qualitative analysis showed that participants agreed that the multidimensional assessment assessed the effect of the pandemic and that it was better suited to the well-educated. Conclusion The questionnaire has good content validity and can be used to assess the impact of the pandemic in cross-sectional studies especially as individual items. The PSI and self-care strategies need revision to ensure the inclusion of items with strong discrimination.
first_indexed 2024-04-13T13:07:31Z
format Article
id doaj.art-7f9055f810ac4698b9116c618bc616f9
institution Directory Open Access Journal
issn 1471-2458
language English
last_indexed 2024-04-13T13:07:31Z
publishDate 2022-08-01
publisher BMC
record_format Article
series BMC Public Health
spelling doaj.art-7f9055f810ac4698b9116c618bc616f92022-12-22T02:45:43ZengBMCBMC Public Health1471-24582022-08-0122111810.1186/s12889-022-13825-2Validation of a COVID-19 mental health and wellness survey questionnaireMaha El Tantawi0Morenike Oluwatoyin Folayan1Annie Lu Nguyen2Nourhan M. Aly3Oliver Ezechi4Benjamin S. C. Uzochukwu5Oluwatoyin Adedoyin Alaba6Brandon Brown7Department of Pediatric Dentistry and Dental Public Health, Faculty of Dentistry, Alexandria UniversityDepartment of Child Dental Health, Obafemi Awolowo UniversityDepartment of Family Medicine, Keck School of Medicine, University of Southern CaliforniaDepartment of Pediatric Dentistry and Dental Public Health, Faculty of Dentistry, Alexandria UniversityClinical Sciences Department, Nigerian Institute of Medical ResearchDepartment of Community Medicine, University of NigeriaInstitute of Public Health, Obafemi Awolowo UniversityCenter for Healthy Communities, Department of Social Medicine, Population and Public Health, University of California, Riverside School of MedicineAbstract Background and aim COVID-19 affected mental health and wellbeing. Research is needed to assess its impact using validated tools. The study assessed the content validity, reliability and dimensionality of a multidimensional tool for assessing the mental health and wellbeing of adults. Methods An online questionnaire collected data in the second half of 2020 from adults in different countries. The questionnaire included nine sections assessing: COVID-19 experience and sociodemographic profile; health and memory; pandemic stress (pandemic stress index, PSI); financial and lifestyle impact; social support; post-traumatic stress disorder (PTSD); coping strategies; self-care and HIV profile over 57 questions. Content validity was assessed (content validity index, CVI) and participants evaluated the test-retest reliability (Kappa statistic and intra-class correlation coefficient, ICC). Internal consistency of scales was assessed (Cronbach α). The dimensionality of the PSI sections and self-care strategies was assessed by multiple correspondence analysis (MCA) using all responses and SPSS. For qualitative validation, we used a semi-structured interview and NVivo was used for coding and thematic analysis. Results The overall CVI = 0.83 with lower values for the memory items. Cronbach α for the memory items = 0.94 and ICC = 0.71. Cronbach α for PTSD items was 0.93 and ICC = 0.89. Test-retest scores varied by section. The 2-dimensions solution of MCA for the PSI behavior section explained 33.6% (precautionary measures dimension), 11.4% (response to impact dimension) and overall variance = 45%. The 2-dimensions of the PSI psychosocial impact explained 23.5% (psychosocial impact of the pandemic dimension), 8.3% (psychosocial impact of the precautionary measures of the pandemic dimension) and overall variance = 31.8%. The 2-dimensions of self-care explained 32.9% (dimension of self-care strategies by people who prefer to stay at home and avoid others), 9% (dimension of self-care strategies by outward-going people) and overall variance = 41.9%. Qualitative analysis showed that participants agreed that the multidimensional assessment assessed the effect of the pandemic and that it was better suited to the well-educated. Conclusion The questionnaire has good content validity and can be used to assess the impact of the pandemic in cross-sectional studies especially as individual items. The PSI and self-care strategies need revision to ensure the inclusion of items with strong discrimination.https://doi.org/10.1186/s12889-022-13825-2ValidityReliabilityQuestionnaireCOVID-19StressMultiple correspondence analysis
spellingShingle Maha El Tantawi
Morenike Oluwatoyin Folayan
Annie Lu Nguyen
Nourhan M. Aly
Oliver Ezechi
Benjamin S. C. Uzochukwu
Oluwatoyin Adedoyin Alaba
Brandon Brown
Validation of a COVID-19 mental health and wellness survey questionnaire
BMC Public Health
Validity
Reliability
Questionnaire
COVID-19
Stress
Multiple correspondence analysis
title Validation of a COVID-19 mental health and wellness survey questionnaire
title_full Validation of a COVID-19 mental health and wellness survey questionnaire
title_fullStr Validation of a COVID-19 mental health and wellness survey questionnaire
title_full_unstemmed Validation of a COVID-19 mental health and wellness survey questionnaire
title_short Validation of a COVID-19 mental health and wellness survey questionnaire
title_sort validation of a covid 19 mental health and wellness survey questionnaire
topic Validity
Reliability
Questionnaire
COVID-19
Stress
Multiple correspondence analysis
url https://doi.org/10.1186/s12889-022-13825-2
work_keys_str_mv AT mahaeltantawi validationofacovid19mentalhealthandwellnesssurveyquestionnaire
AT morenikeoluwatoyinfolayan validationofacovid19mentalhealthandwellnesssurveyquestionnaire
AT annielunguyen validationofacovid19mentalhealthandwellnesssurveyquestionnaire
AT nourhanmaly validationofacovid19mentalhealthandwellnesssurveyquestionnaire
AT oliverezechi validationofacovid19mentalhealthandwellnesssurveyquestionnaire
AT benjaminscuzochukwu validationofacovid19mentalhealthandwellnesssurveyquestionnaire
AT oluwatoyinadedoyinalaba validationofacovid19mentalhealthandwellnesssurveyquestionnaire
AT brandonbrown validationofacovid19mentalhealthandwellnesssurveyquestionnaire