Assessing undergraduate learning in earth science residential fieldwork
One of the challenges for module and academic programme coordinators is having to simultaneously measure module outcomes, programme outcomes and the development of graduate attributes. Reliable measures of student growth are difficult to obtain because much of what students are asked to do in their...
| Váldodahkkit: | , , , , |
|---|---|
| Eará dahkkit: | |
| Materiálatiipa: | Journal Article |
| Giella: | English |
| Almmustuhtton: |
2020
|
| Fáttát: | |
| Liŋkkat: | https://hdl.handle.net/10356/143571 |
| _version_ | 1826122231127736320 |
|---|---|
| author | Chua, Stephen Switzer, Adam D. Hartman, Kevin Bhatia, Natasha Koh, Jaime |
| author2 | Asian School of the Environment |
| author_facet | Asian School of the Environment Chua, Stephen Switzer, Adam D. Hartman, Kevin Bhatia, Natasha Koh, Jaime |
| author_sort | Chua, Stephen |
| collection | NTU |
| description | One of the challenges for module and academic programme coordinators is having to simultaneously measure module outcomes, programme outcomes and the development of graduate attributes. Reliable measures of student growth are difficult to obtain because much of what students are asked to do in their modules is not made available to stakeholders in an easily analysable form. In the earth sciences, fieldwork provides both a consistently orchestrated activity that students repeat at multiple time points in their academic careers and an activity that yields artefacts that can be flexibly analysed depending on a programme’s intended outcomes and the university’s desired attributes.
Fieldwork is an essential component of undergraduate earth science education, and provides a platform for students to learn in a ‘real-world’ setting which is not readily replicated in more traditional methods (e.g. lectures, tutorials). Students record their field experience and accomplish field-based tasks in field notebooks, where careful assessment of these books serve to measure student learning and the development of key skills and competencies integral to their progress as future earth scientists. Based on the collected corpus of student field notebooks, we crafted a generalisable rubric to assess student field notebooks for programme outcomes and the presence of the university’s graduate attributes. The rubric was modelled on the Structure of Observed Learning Outcomes (SOLO) taxonomy (Biggs & Collis, 1989; Biggs & Collis, 2014), a structured method of classifying learning outcomes.
A cross-sectional and longitudinal analysis of three student cohorts indicated that the presence of the key skills, competencies, and attributes the programme and university value increased over time. We found that earth science undergraduates generally showed greater sophistication in parameters related to their capacity to organise field information, record information via text, and identify field features, but displayed lower levels of sophistication in aspects related to the use of field symbols and critical thinking. A longitudinal comparison indicated students showed an increase, at the cohort level, in the use of field conventions and textual recording, but showed a decrease in the presence of critical thinking. The changes could be due to the inherent nature of field-based tasks which do not create situations to test higher-order thinking. The findings from this study can thus be used by both students to make informed decisions to improve their own learning (formative assessment), as well as field instructors in possible redesigning of fieldwork content and pedagogy. |
| first_indexed | 2024-10-01T05:45:06Z |
| format | Journal Article |
| id | ntu-10356/143571 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:45:06Z |
| publishDate | 2020 |
| record_format | dspace |
| spelling | ntu-10356/1435712023-02-28T16:41:04Z Assessing undergraduate learning in earth science residential fieldwork Chua, Stephen Switzer, Adam D. Hartman, Kevin Bhatia, Natasha Koh, Jaime Asian School of the Environment Earth Observatory of Singapore Science Fieldwork Field Notebooks One of the challenges for module and academic programme coordinators is having to simultaneously measure module outcomes, programme outcomes and the development of graduate attributes. Reliable measures of student growth are difficult to obtain because much of what students are asked to do in their modules is not made available to stakeholders in an easily analysable form. In the earth sciences, fieldwork provides both a consistently orchestrated activity that students repeat at multiple time points in their academic careers and an activity that yields artefacts that can be flexibly analysed depending on a programme’s intended outcomes and the university’s desired attributes. Fieldwork is an essential component of undergraduate earth science education, and provides a platform for students to learn in a ‘real-world’ setting which is not readily replicated in more traditional methods (e.g. lectures, tutorials). Students record their field experience and accomplish field-based tasks in field notebooks, where careful assessment of these books serve to measure student learning and the development of key skills and competencies integral to their progress as future earth scientists. Based on the collected corpus of student field notebooks, we crafted a generalisable rubric to assess student field notebooks for programme outcomes and the presence of the university’s graduate attributes. The rubric was modelled on the Structure of Observed Learning Outcomes (SOLO) taxonomy (Biggs & Collis, 1989; Biggs & Collis, 2014), a structured method of classifying learning outcomes. A cross-sectional and longitudinal analysis of three student cohorts indicated that the presence of the key skills, competencies, and attributes the programme and university value increased over time. We found that earth science undergraduates generally showed greater sophistication in parameters related to their capacity to organise field information, record information via text, and identify field features, but displayed lower levels of sophistication in aspects related to the use of field symbols and critical thinking. A longitudinal comparison indicated students showed an increase, at the cohort level, in the use of field conventions and textual recording, but showed a decrease in the presence of critical thinking. The changes could be due to the inherent nature of field-based tasks which do not create situations to test higher-order thinking. The findings from this study can thus be used by both students to make informed decisions to improve their own learning (formative assessment), as well as field instructors in possible redesigning of fieldwork content and pedagogy. Published version 2020-09-09T08:36:14Z 2020-09-09T08:36:14Z 2020 Journal Article Chua, S., Switzer, A. D., Hartman, K., Bhatia, N., & Koh, J. (2020). Assessing undergraduate learning in earth science residential fieldwork. Asian Journal of the Scholarship of Teaching and Learning, 10(1), 69-88. - https://hdl.handle.net/10356/143571 1 10 69 88 en Asian Journal of the Scholarship of Teaching and Learning @ 2020 The Author(s) (published by Asian Journal of the Scholarship of Teaching and Learning). This is an open-access article distributed under the terms of the Creative Commons Attribution License. application/pdf |
| spellingShingle | Science Fieldwork Field Notebooks Chua, Stephen Switzer, Adam D. Hartman, Kevin Bhatia, Natasha Koh, Jaime Assessing undergraduate learning in earth science residential fieldwork |
| title | Assessing undergraduate learning in earth science residential fieldwork |
| title_full | Assessing undergraduate learning in earth science residential fieldwork |
| title_fullStr | Assessing undergraduate learning in earth science residential fieldwork |
| title_full_unstemmed | Assessing undergraduate learning in earth science residential fieldwork |
| title_short | Assessing undergraduate learning in earth science residential fieldwork |
| title_sort | assessing undergraduate learning in earth science residential fieldwork |
| topic | Science Fieldwork Field Notebooks |
| url | https://hdl.handle.net/10356/143571 |
| work_keys_str_mv | AT chuastephen assessingundergraduatelearninginearthscienceresidentialfieldwork AT switzeradamd assessingundergraduatelearninginearthscienceresidentialfieldwork AT hartmankevin assessingundergraduatelearninginearthscienceresidentialfieldwork AT bhatianatasha assessingundergraduatelearninginearthscienceresidentialfieldwork AT kohjaime assessingundergraduatelearninginearthscienceresidentialfieldwork |