Measuring informal workplace learning outcomes in residency training: a validation study
Abstract Background Informal workplace learning (WPL) has no concrete learning objective and takes place without a responsible supervisor, which makes it difficult to assess its learning outcomes. Formal learning situations, as they are known from universities or schools, do not exist in this contex...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-08-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12909-023-04529-1 |
| _version_ | 1797452250004586496 |
|---|---|
| author | Markus Heim Christian M. Schulz Frederick Schneider Pascal O. Berberat Martin Gartmeier Kristina Schick |
| author_facet | Markus Heim Christian M. Schulz Frederick Schneider Pascal O. Berberat Martin Gartmeier Kristina Schick |
| author_sort | Markus Heim |
| collection | DOAJ |
| description | Abstract Background Informal workplace learning (WPL) has no concrete learning objective and takes place without a responsible supervisor, which makes it difficult to assess its learning outcomes. Formal learning situations, as they are known from universities or schools, do not exist in this context and make a conventional assessment of learning goals and achievements impossible. Informal learning in the workplace is of central importance, and the assessment of informal learning outcomes in medical education is an under-researched area. The aim of our study was to adapt and validate an informal WPL questionnaire (originally developed for social workers) to assess learning outcomes due to informal WPL in residency training. Methods A total of 528 residents (n = 339 female; age: M = 29.79; SD = 3.37 years) completed an adapted questionnaire on informal WPL outcomes and the Freiburg Questionnaire to Assess Competencies in Medicine (i.e. medical knowledge, communication, and scholarship). Exploratory factor analysis was used to determine the underlying factor structure. The reliability of the factors was tested using McDonald’s omega, and the correlation between the factors and the three subscales of the Freiburg questionnaire was tested using Spearman’s rho correlation coefficient. To investigate construct validity, a structural equation model was calculated to examine the relationships between medical competencies and informal learning outcomes. Results The exploratory factor analysis yielded a four-factor solution that best fit the data. The scores of all four factors (GLO-CD: generic learning outcomes—competence development, GLO-R: generic learning outcomes—reflection, JSLO: job-specific learning outcomes, and OLLO: organisational learning outcomes) showed good internal consistency (Ω ≥ .69). The structural equation model showed that "medical expertise" had an impact on all four factors of informal learning at work. “Scholarship” seemed to predict GLO-CD and GLO-R. Conclusions Our four-factor model reveals meaningful determinants of informal WPL in relation to residency training. The instrument is therefore the first promising attempt to assess informal WPL in the broader context of medical education during residency, thus supporting its construct validity. |
| first_indexed | 2024-03-09T15:06:05Z |
| format | Article |
| id | doaj.art-8c04747c713f490aa5dcee2aefb23acc |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-03-09T15:06:05Z |
| publishDate | 2023-08-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-8c04747c713f490aa5dcee2aefb23acc2023-11-26T13:40:07ZengBMCBMC Medical Education1472-69202023-08-0123111210.1186/s12909-023-04529-1Measuring informal workplace learning outcomes in residency training: a validation studyMarkus Heim0Christian M. Schulz1Frederick Schneider2Pascal O. Berberat3Martin Gartmeier4Kristina Schick5Technical University of Munich, TUM School of Medicine, Department of Anesthesiology and Intensive Care MedicineTechnical University of Munich, TUM School of Medicine, Department of Anesthesiology and Intensive Care MedicineTechnical University of Munich, TUM School of Medicine, Department of Anesthesiology and Intensive Care MedicineTechnical University Munich, TUM School of Medicine, TUM Medical Education CenterTechnical University Munich, TUM School of Medicine, TUM Medical Education CenterTechnical University Munich, TUM School of Medicine, TUM Medical Education CenterAbstract Background Informal workplace learning (WPL) has no concrete learning objective and takes place without a responsible supervisor, which makes it difficult to assess its learning outcomes. Formal learning situations, as they are known from universities or schools, do not exist in this context and make a conventional assessment of learning goals and achievements impossible. Informal learning in the workplace is of central importance, and the assessment of informal learning outcomes in medical education is an under-researched area. The aim of our study was to adapt and validate an informal WPL questionnaire (originally developed for social workers) to assess learning outcomes due to informal WPL in residency training. Methods A total of 528 residents (n = 339 female; age: M = 29.79; SD = 3.37 years) completed an adapted questionnaire on informal WPL outcomes and the Freiburg Questionnaire to Assess Competencies in Medicine (i.e. medical knowledge, communication, and scholarship). Exploratory factor analysis was used to determine the underlying factor structure. The reliability of the factors was tested using McDonald’s omega, and the correlation between the factors and the three subscales of the Freiburg questionnaire was tested using Spearman’s rho correlation coefficient. To investigate construct validity, a structural equation model was calculated to examine the relationships between medical competencies and informal learning outcomes. Results The exploratory factor analysis yielded a four-factor solution that best fit the data. The scores of all four factors (GLO-CD: generic learning outcomes—competence development, GLO-R: generic learning outcomes—reflection, JSLO: job-specific learning outcomes, and OLLO: organisational learning outcomes) showed good internal consistency (Ω ≥ .69). The structural equation model showed that "medical expertise" had an impact on all four factors of informal learning at work. “Scholarship” seemed to predict GLO-CD and GLO-R. Conclusions Our four-factor model reveals meaningful determinants of informal WPL in relation to residency training. The instrument is therefore the first promising attempt to assess informal WPL in the broader context of medical education during residency, thus supporting its construct validity.https://doi.org/10.1186/s12909-023-04529-1Informal workplace learning outcomesResidency trainingValidationSelf-report measure |
| spellingShingle | Markus Heim Christian M. Schulz Frederick Schneider Pascal O. Berberat Martin Gartmeier Kristina Schick Measuring informal workplace learning outcomes in residency training: a validation study BMC Medical Education Informal workplace learning outcomes Residency training Validation Self-report measure |
| title | Measuring informal workplace learning outcomes in residency training: a validation study |
| title_full | Measuring informal workplace learning outcomes in residency training: a validation study |
| title_fullStr | Measuring informal workplace learning outcomes in residency training: a validation study |
| title_full_unstemmed | Measuring informal workplace learning outcomes in residency training: a validation study |
| title_short | Measuring informal workplace learning outcomes in residency training: a validation study |
| title_sort | measuring informal workplace learning outcomes in residency training a validation study |
| topic | Informal workplace learning outcomes Residency training Validation Self-report measure |
| url | https://doi.org/10.1186/s12909-023-04529-1 |
| work_keys_str_mv | AT markusheim measuringinformalworkplacelearningoutcomesinresidencytrainingavalidationstudy AT christianmschulz measuringinformalworkplacelearningoutcomesinresidencytrainingavalidationstudy AT frederickschneider measuringinformalworkplacelearningoutcomesinresidencytrainingavalidationstudy AT pascaloberberat measuringinformalworkplacelearningoutcomesinresidencytrainingavalidationstudy AT martingartmeier measuringinformalworkplacelearningoutcomesinresidencytrainingavalidationstudy AT kristinaschick measuringinformalworkplacelearningoutcomesinresidencytrainingavalidationstudy |