A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology Course
The objectives of this study were to investigate the alignment of exam questions with course learning outcomes in a first year biology majors course, to examine gaps and overlaps in assessment of content amongst the sections of the course, and to use this information to provide feedback to the teach...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Society for Teaching and Learning in Higher Education
2010-06-01
|
| Series: | Canadian Journal for the Scholarship of Teaching and Learning |
| Subjects: | |
| Online Access: | http://ir.lib.uwo.ca/cjsotl_rcacea/vol1/iss1/8 |
| _version_ | 1818421386911154176 |
|---|---|
| author | Carol Pollock Gülnur Birol Angie O'Neill |
| author_facet | Carol Pollock Gülnur Birol Angie O'Neill |
| author_sort | Carol Pollock |
| collection | DOAJ |
| description | The objectives of this study were to investigate the alignment of exam questions with course learning outcomes in a first year biology majors course, to examine gaps and overlaps in assessment of content amongst the sections of the course, and to use this information to provide feedback to the teaching team to further improve the course. Our ultimate goal was to provide students with learning outcomes that would clearly indicate the content and the level at which they would be expected to learn the content for this course, regardless of the section in which they were registered. We took an evidence-based approach to course evaluation and employed the Blooming Biology Tool to compare the learning outcomes and the exam questions of the course, investigating whether the cognitive skill level of each learning outcome as written matched the level at which it was assessed. We identified misalignments and recommended revising the learning outcomes to better reflect the intended level of learning for the course. We also investigated student performance on exam questions of different cognitive levels and found that students scored statistically significantly higher (p < .05) on questions in which learning outcomes were tested at the stated cognitive skill level compared to at a higher level.Les objectifs de cette étude étaient (1) d’examiner la correspondance entre les questions d’examen et les résultats en matière d’apprentissage pour un cours de première année d’une majeure en biologie, (2) d’étudier les écarts et les chevauchements en matière d’évaluation du contenu des sections du cours et (3) d’utiliser ces informations pour fournir de la rétroaction à l’équipe des enseignants afin d’améliorer le cours. Notre but ultime était de faire en sorte que les résultats de l’apprentissage des étudiants indiquent clairement le contenu à apprendre et le niveau cognitif qu’ils devraient avoir atteint, peu importe la section à laquelle ils s’étaient inscrits. Nous avons utilisé une approche basée sur les données probantes pour évaluer le cours ainsi que l’outil de taxonomie de Bloom appliqué à biologie pour comparer les résultats d’apprentissage et les questions d’examen du cours. Nous souhaitions ainsi vérifier si le niveau de compétences cognitives tel qu’il est écrit pour chaque résultat d’apprentissage correspondait au niveau auquel il était évalué. Nous avons découvert des correspondances inadéquates et avons recommandé de réviser les résultats d’apprentissage pour mieux refléter le niveau d’apprentissage souhaité dans le cours. Nous avons également étudié la performance des étudiants aux questions d’examens en fonction de différents niveaux cognitifs et avons découvert que les résultats des étudiants étaient significativement plus élevés sur le plan statistique (p < 0,05) pour les questions où les résultats d’apprentissage étaient vérifiés au niveau des compétences cognitives déclaré, plutôt qu’à un niveau plus élevé. |
| first_indexed | 2024-12-14T13:09:33Z |
| format | Article |
| id | doaj.art-811a5a07757d406894169e5b41580ad5 |
| institution | Directory Open Access Journal |
| issn | 1918-2902 |
| language | English |
| last_indexed | 2024-12-14T13:09:33Z |
| publishDate | 2010-06-01 |
| publisher | Society for Teaching and Learning in Higher Education |
| record_format | Article |
| series | Canadian Journal for the Scholarship of Teaching and Learning |
| spelling | doaj.art-811a5a07757d406894169e5b41580ad52022-12-21T23:00:14ZengSociety for Teaching and Learning in Higher EducationCanadian Journal for the Scholarship of Teaching and Learning1918-29022010-06-0111http://dx.doi.org/10.5206/cjsotl-rcacea.2010.1.8A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology CourseCarol PollockGülnur BirolAngie O'NeillThe objectives of this study were to investigate the alignment of exam questions with course learning outcomes in a first year biology majors course, to examine gaps and overlaps in assessment of content amongst the sections of the course, and to use this information to provide feedback to the teaching team to further improve the course. Our ultimate goal was to provide students with learning outcomes that would clearly indicate the content and the level at which they would be expected to learn the content for this course, regardless of the section in which they were registered. We took an evidence-based approach to course evaluation and employed the Blooming Biology Tool to compare the learning outcomes and the exam questions of the course, investigating whether the cognitive skill level of each learning outcome as written matched the level at which it was assessed. We identified misalignments and recommended revising the learning outcomes to better reflect the intended level of learning for the course. We also investigated student performance on exam questions of different cognitive levels and found that students scored statistically significantly higher (p < .05) on questions in which learning outcomes were tested at the stated cognitive skill level compared to at a higher level.Les objectifs de cette étude étaient (1) d’examiner la correspondance entre les questions d’examen et les résultats en matière d’apprentissage pour un cours de première année d’une majeure en biologie, (2) d’étudier les écarts et les chevauchements en matière d’évaluation du contenu des sections du cours et (3) d’utiliser ces informations pour fournir de la rétroaction à l’équipe des enseignants afin d’améliorer le cours. Notre but ultime était de faire en sorte que les résultats de l’apprentissage des étudiants indiquent clairement le contenu à apprendre et le niveau cognitif qu’ils devraient avoir atteint, peu importe la section à laquelle ils s’étaient inscrits. Nous avons utilisé une approche basée sur les données probantes pour évaluer le cours ainsi que l’outil de taxonomie de Bloom appliqué à biologie pour comparer les résultats d’apprentissage et les questions d’examen du cours. Nous souhaitions ainsi vérifier si le niveau de compétences cognitives tel qu’il est écrit pour chaque résultat d’apprentissage correspondait au niveau auquel il était évalué. Nous avons découvert des correspondances inadéquates et avons recommandé de réviser les résultats d’apprentissage pour mieux refléter le niveau d’apprentissage souhaité dans le cours. Nous avons également étudié la performance des étudiants aux questions d’examens en fonction de différents niveaux cognitifs et avons découvert que les résultats des étudiants étaient significativement plus élevés sur le plan statistique (p < 0,05) pour les questions où les résultats d’apprentissage étaient vérifiés au niveau des compétences cognitives déclaré, plutôt qu’à un niveau plus élevé.http://ir.lib.uwo.ca/cjsotl_rcacea/vol1/iss1/8learning objectivesassessmentbiologyBlooming Biology Toollarge classes |
| spellingShingle | Carol Pollock Gülnur Birol Angie O'Neill A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology Course Canadian Journal for the Scholarship of Teaching and Learning learning objectives assessment biology Blooming Biology Tool large classes |
| title | A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology Course |
| title_full | A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology Course |
| title_fullStr | A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology Course |
| title_full_unstemmed | A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology Course |
| title_short | A Report on the Implementation of the Blooming Biology Tool: Aligning Course Learning Outcomes with Assessments and Promoting Consistency in a Large Multi-Section First-Year Biology Course |
| title_sort | report on the implementation of the blooming biology tool aligning course learning outcomes with assessments and promoting consistency in a large multi section first year biology course |
| topic | learning objectives assessment biology Blooming Biology Tool large classes |
| url | http://ir.lib.uwo.ca/cjsotl_rcacea/vol1/iss1/8 |
| work_keys_str_mv | AT carolpollock areportontheimplementationofthebloomingbiologytoolaligningcourselearningoutcomeswithassessmentsandpromotingconsistencyinalargemultisectionfirstyearbiologycourse AT gulnurbirol areportontheimplementationofthebloomingbiologytoolaligningcourselearningoutcomeswithassessmentsandpromotingconsistencyinalargemultisectionfirstyearbiologycourse AT angieoneill areportontheimplementationofthebloomingbiologytoolaligningcourselearningoutcomeswithassessmentsandpromotingconsistencyinalargemultisectionfirstyearbiologycourse AT carolpollock reportontheimplementationofthebloomingbiologytoolaligningcourselearningoutcomeswithassessmentsandpromotingconsistencyinalargemultisectionfirstyearbiologycourse AT gulnurbirol reportontheimplementationofthebloomingbiologytoolaligningcourselearningoutcomeswithassessmentsandpromotingconsistencyinalargemultisectionfirstyearbiologycourse AT angieoneill reportontheimplementationofthebloomingbiologytoolaligningcourselearningoutcomeswithassessmentsandpromotingconsistencyinalargemultisectionfirstyearbiologycourse |