Development and preliminary psychometric properties of a well-being index for medical students

<p>Abstract</p> <p>Background</p> <p>Psychological distress is common among medical students but manifests in a variety of forms. Currently, no brief, practical tool exists to simultaneously evaluate these domains of distress among medical students. The authors describe...

Full description

Bibliographic Details
Main Authors: Sloan Jeff A, Downing Steven M, Szydlo Daniel W, Dyrbye Liselotte N, Shanafelt Tait D
Format: Article
Language:English
Published: BMC 2010-01-01
Series:BMC Medical Education
Online Access:http://www.biomedcentral.com/1472-6920/10/8
_version_ 1828925443726639104
author Sloan Jeff A
Downing Steven M
Szydlo Daniel W
Dyrbye Liselotte N
Shanafelt Tait D
author_facet Sloan Jeff A
Downing Steven M
Szydlo Daniel W
Dyrbye Liselotte N
Shanafelt Tait D
author_sort Sloan Jeff A
collection DOAJ
description <p>Abstract</p> <p>Background</p> <p>Psychological distress is common among medical students but manifests in a variety of forms. Currently, no brief, practical tool exists to simultaneously evaluate these domains of distress among medical students. The authors describe the development of a subject-reported assessment (Medical Student Well-Being Index, MSWBI) intended to screen for medical student distress across a variety of domains and examine its preliminary psychometric properties.</p> <p>Methods</p> <p>Relevant domains of distress were identified, items generated, and a screening instrument formed using a process of literature review, nominal group technique, input from deans and medical students, and correlation analysis from previously administered assessments. Eleven experts judged the clarity, relevance, and representativeness of the items. A Content Validity Index (CVI) was calculated. Interrater agreement was assessed using pair-wise percent agreement adjusted for chance agreement. Data from 2248 medical students who completed the MSWBI along with validated full-length instruments assessing domains of interest was used to calculate reliability and explore internal structure validity.</p> <p>Results</p> <p>Burnout (emotional exhaustion and depersonalization), depression, mental quality of life (QOL), physical QOL, stress, and fatigue were domains identified for inclusion in the MSWBI. Six of 7 items received item CVI-relevance and CVI-representativeness of ≥0.82. Overall scale CVI-relevance and CVI-representativeness was 0.94 and 0.91. Overall pair-wise percent agreement between raters was ≥85% for clarity, relevance, and representativeness. Cronbach's alpha was 0.68. Item by item percent pair-wise agreements and Phi were low, suggesting little overlap between items. The majority of MSWBI items had a ≥74% sensitivity and specificity for detecting distress within the intended domain.</p> <p>Conclusions</p> <p>The results of this study provide evidence of reliability and content-related validity of the MSWBI. Further research is needed to assess remaining psychometric properties and establish scores for which intervention is warranted.</p>
first_indexed 2024-12-13T23:15:27Z
format Article
id doaj.art-ec8b1de53f374bb3a0dc376c87db1d21
institution Directory Open Access Journal
issn 1472-6920
language English
last_indexed 2024-12-13T23:15:27Z
publishDate 2010-01-01
publisher BMC
record_format Article
series BMC Medical Education
spelling doaj.art-ec8b1de53f374bb3a0dc376c87db1d212022-12-21T23:27:58ZengBMCBMC Medical Education1472-69202010-01-01101810.1186/1472-6920-10-8Development and preliminary psychometric properties of a well-being index for medical studentsSloan Jeff ADowning Steven MSzydlo Daniel WDyrbye Liselotte NShanafelt Tait D<p>Abstract</p> <p>Background</p> <p>Psychological distress is common among medical students but manifests in a variety of forms. Currently, no brief, practical tool exists to simultaneously evaluate these domains of distress among medical students. The authors describe the development of a subject-reported assessment (Medical Student Well-Being Index, MSWBI) intended to screen for medical student distress across a variety of domains and examine its preliminary psychometric properties.</p> <p>Methods</p> <p>Relevant domains of distress were identified, items generated, and a screening instrument formed using a process of literature review, nominal group technique, input from deans and medical students, and correlation analysis from previously administered assessments. Eleven experts judged the clarity, relevance, and representativeness of the items. A Content Validity Index (CVI) was calculated. Interrater agreement was assessed using pair-wise percent agreement adjusted for chance agreement. Data from 2248 medical students who completed the MSWBI along with validated full-length instruments assessing domains of interest was used to calculate reliability and explore internal structure validity.</p> <p>Results</p> <p>Burnout (emotional exhaustion and depersonalization), depression, mental quality of life (QOL), physical QOL, stress, and fatigue were domains identified for inclusion in the MSWBI. Six of 7 items received item CVI-relevance and CVI-representativeness of ≥0.82. Overall scale CVI-relevance and CVI-representativeness was 0.94 and 0.91. Overall pair-wise percent agreement between raters was ≥85% for clarity, relevance, and representativeness. Cronbach's alpha was 0.68. Item by item percent pair-wise agreements and Phi were low, suggesting little overlap between items. The majority of MSWBI items had a ≥74% sensitivity and specificity for detecting distress within the intended domain.</p> <p>Conclusions</p> <p>The results of this study provide evidence of reliability and content-related validity of the MSWBI. Further research is needed to assess remaining psychometric properties and establish scores for which intervention is warranted.</p>http://www.biomedcentral.com/1472-6920/10/8
spellingShingle Sloan Jeff A
Downing Steven M
Szydlo Daniel W
Dyrbye Liselotte N
Shanafelt Tait D
Development and preliminary psychometric properties of a well-being index for medical students
BMC Medical Education
title Development and preliminary psychometric properties of a well-being index for medical students
title_full Development and preliminary psychometric properties of a well-being index for medical students
title_fullStr Development and preliminary psychometric properties of a well-being index for medical students
title_full_unstemmed Development and preliminary psychometric properties of a well-being index for medical students
title_short Development and preliminary psychometric properties of a well-being index for medical students
title_sort development and preliminary psychometric properties of a well being index for medical students
url http://www.biomedcentral.com/1472-6920/10/8
work_keys_str_mv AT sloanjeffa developmentandpreliminarypsychometricpropertiesofawellbeingindexformedicalstudents
AT downingstevenm developmentandpreliminarypsychometricpropertiesofawellbeingindexformedicalstudents
AT szydlodanielw developmentandpreliminarypsychometricpropertiesofawellbeingindexformedicalstudents
AT dyrbyeliselotten developmentandpreliminarypsychometricpropertiesofawellbeingindexformedicalstudents
AT shanafelttaitd developmentandpreliminarypsychometricpropertiesofawellbeingindexformedicalstudents