Psychometric properties of the mock interview rating scale for autistic transition-age youth
BackgroundEmployment is a major contributor to quality of life. However, autistic people are often unemployed and underemployed. One potential barrier to employment is the job interview. However, the availability of psychometrically-evaluated assessments of job interviewing skills is limited for aut...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-11-01
|
| Series: | Frontiers in Psychiatry |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1235056/full |
| _version_ | 1797635562313613312 |
|---|---|
| author | Matthew J. Smith Kari L. Sherwood Kari L. Sherwood Helen M. Genova Helen M. Genova Brittany Ross Leann Smith DaWalt Lauren Bishop Lauren Bishop David Telfer Cheryl Brown Barbara Sanchez Michael A. Kallen |
| author_facet | Matthew J. Smith Kari L. Sherwood Kari L. Sherwood Helen M. Genova Helen M. Genova Brittany Ross Leann Smith DaWalt Lauren Bishop Lauren Bishop David Telfer Cheryl Brown Barbara Sanchez Michael A. Kallen |
| author_sort | Matthew J. Smith |
| collection | DOAJ |
| description | BackgroundEmployment is a major contributor to quality of life. However, autistic people are often unemployed and underemployed. One potential barrier to employment is the job interview. However, the availability of psychometrically-evaluated assessments of job interviewing skills is limited for autism services providers and researchers.ObjectiveWe analyzed the psychometric properties of the Mock Interview Rating Scale that was adapted for research with autistic transition-age youth (A-MIRS; a comprehensive assessment of video-recorded job interview role-play scenarios using anchor-based ratings for 14 scripted job scenarios).MethodsEighty-five transition-age youth with autism completed one of two randomized controlled trials to test the effectiveness of two interventions focused on job interview skills. All participants completed a single job interview role-play at pre-test that was scored by raters using the A-MIRS. We analyzed the structure of the A-MIRS using classical test theory, which involved conducting both exploratory and confirmatory factor analyzes, Rasch model analysis and calibration techniques. We then assessed internal consistency, inter-rater reliability, and test–retest reliability. Pearson correlations were used to assess the A-MIRS’ construct, convergent, divergent, criterion, and predictive validities by comparing it to demographic, clinical, cognitive, work history measures, and employment outcomes.ResultsResults revealed an 11-item unidimensional construct with strong internal consistency, inter-rater reliability, and test–retest reliability. Construct [pragmatic social skills (r = 0.61, p < 0.001), self-reported interview skills (r = 0.34, p = 0.001)], divergent [e.g., age (r = −0.13, p = 0.26), race (r = 0.02, p = 0.87)], and predictive validities [competitive employment (r = 0.31, p = 0.03)] received initial support via study correlations, while convergent [e.g., intrinsic motivation (r = 0.32, p = 0.007), job interview anxiety (r = −0.19, p = 0.08)] and criterion [e.g., prior employment (r = 0.22, p = 0.046), current employment (r = 0.21, p = 0.054)] validities were limited.ConclusionThe psychometric properties of the 11-item A-MIRS ranged from strong-to-acceptable, indicating it may have utility as a reliable and valid method for assessing the job interview skills of autistic transition-age youth. |
| first_indexed | 2024-03-11T12:23:33Z |
| format | Article |
| id | doaj.art-38adb6fb90fc48c48968194f7f9f2428 |
| institution | Directory Open Access Journal |
| issn | 1664-0640 |
| language | English |
| last_indexed | 2024-03-11T12:23:33Z |
| publishDate | 2023-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Psychiatry |
| spelling | doaj.art-38adb6fb90fc48c48968194f7f9f24282023-11-06T16:11:21ZengFrontiers Media S.A.Frontiers in Psychiatry1664-06402023-11-011410.3389/fpsyt.2023.12350561235056Psychometric properties of the mock interview rating scale for autistic transition-age youthMatthew J. Smith0Kari L. Sherwood1Kari L. Sherwood2Helen M. Genova3Helen M. Genova4Brittany Ross5Leann Smith DaWalt6Lauren Bishop7Lauren Bishop8David Telfer9Cheryl Brown10Barbara Sanchez11Michael A. Kallen12School of Social Work, University of Michigan, Ann Arbor, MI, United StatesSchool of Social Work, University of Michigan, Ann Arbor, MI, United StatesDepartment of Psychology, University of Michigan, Ann Arbor, MI, United StatesKessler Foundation, East Hanover, NJ, United StatesDepartment of Physical Medicine and Rehabilitation, Rutgers New Jersey Medical School, Newark, NJ, United StatesSchool of Social Work, University of Michigan, Ann Arbor, MI, United StatesWaisman Center, University of Wisconsin, Madison, WI, United StatesWaisman Center, University of Wisconsin, Madison, WI, United StatesSandra Rosenbaum School of Social Work, University of Wisconsin, Madison, WI, United StatesConsultant, Warren, RI, United StatesAnn Arbor Public Schools, Ann Arbor, MI, United StatesAnn Arbor Academy, Ann Arbor, MI, United States0Feinberg School of Medicine, Northwestern University, Chicago, IL, United StatesBackgroundEmployment is a major contributor to quality of life. However, autistic people are often unemployed and underemployed. One potential barrier to employment is the job interview. However, the availability of psychometrically-evaluated assessments of job interviewing skills is limited for autism services providers and researchers.ObjectiveWe analyzed the psychometric properties of the Mock Interview Rating Scale that was adapted for research with autistic transition-age youth (A-MIRS; a comprehensive assessment of video-recorded job interview role-play scenarios using anchor-based ratings for 14 scripted job scenarios).MethodsEighty-five transition-age youth with autism completed one of two randomized controlled trials to test the effectiveness of two interventions focused on job interview skills. All participants completed a single job interview role-play at pre-test that was scored by raters using the A-MIRS. We analyzed the structure of the A-MIRS using classical test theory, which involved conducting both exploratory and confirmatory factor analyzes, Rasch model analysis and calibration techniques. We then assessed internal consistency, inter-rater reliability, and test–retest reliability. Pearson correlations were used to assess the A-MIRS’ construct, convergent, divergent, criterion, and predictive validities by comparing it to demographic, clinical, cognitive, work history measures, and employment outcomes.ResultsResults revealed an 11-item unidimensional construct with strong internal consistency, inter-rater reliability, and test–retest reliability. Construct [pragmatic social skills (r = 0.61, p < 0.001), self-reported interview skills (r = 0.34, p = 0.001)], divergent [e.g., age (r = −0.13, p = 0.26), race (r = 0.02, p = 0.87)], and predictive validities [competitive employment (r = 0.31, p = 0.03)] received initial support via study correlations, while convergent [e.g., intrinsic motivation (r = 0.32, p = 0.007), job interview anxiety (r = −0.19, p = 0.08)] and criterion [e.g., prior employment (r = 0.22, p = 0.046), current employment (r = 0.21, p = 0.054)] validities were limited.ConclusionThe psychometric properties of the 11-item A-MIRS ranged from strong-to-acceptable, indicating it may have utility as a reliable and valid method for assessing the job interview skills of autistic transition-age youth.https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1235056/fullautismjob interview skills assessmentpsychometric propertiesemploymenttransition-age youth |
| spellingShingle | Matthew J. Smith Kari L. Sherwood Kari L. Sherwood Helen M. Genova Helen M. Genova Brittany Ross Leann Smith DaWalt Lauren Bishop Lauren Bishop David Telfer Cheryl Brown Barbara Sanchez Michael A. Kallen Psychometric properties of the mock interview rating scale for autistic transition-age youth Frontiers in Psychiatry autism job interview skills assessment psychometric properties employment transition-age youth |
| title | Psychometric properties of the mock interview rating scale for autistic transition-age youth |
| title_full | Psychometric properties of the mock interview rating scale for autistic transition-age youth |
| title_fullStr | Psychometric properties of the mock interview rating scale for autistic transition-age youth |
| title_full_unstemmed | Psychometric properties of the mock interview rating scale for autistic transition-age youth |
| title_short | Psychometric properties of the mock interview rating scale for autistic transition-age youth |
| title_sort | psychometric properties of the mock interview rating scale for autistic transition age youth |
| topic | autism job interview skills assessment psychometric properties employment transition-age youth |
| url | https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1235056/full |
| work_keys_str_mv | AT matthewjsmith psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT karilsherwood psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT karilsherwood psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT helenmgenova psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT helenmgenova psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT brittanyross psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT leannsmithdawalt psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT laurenbishop psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT laurenbishop psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT davidtelfer psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT cherylbrown psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT barbarasanchez psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth AT michaelakallen psychometricpropertiesofthemockinterviewratingscaleforautistictransitionageyouth |