Evaluation of Speakers at a National Continuing Medical Education (CME) Course

Purpose: Evaluations of a national radiology continuing medical education (CME) course in thoracic imaging were analyzed to determine what constitutes effective and ineffective lecturing. Methods and Materials: Evaluations of sessions and individual speakers participating in a five-day course jointl...

Full description

Bibliographic Details
Main Author: Jannette Collins, MD, MEd, FCCP
Format: Article
Language:English
Published: Taylor & Francis Group 2002-12-01
Series:Medical Education Online
Subjects:
Online Access:http://www.med-ed-online.org/res00047.htm
_version_ 1818807793184931840
author Jannette Collins, MD, MEd, FCCP
author_facet Jannette Collins, MD, MEd, FCCP
author_sort Jannette Collins, MD, MEd, FCCP
collection DOAJ
description Purpose: Evaluations of a national radiology continuing medical education (CME) course in thoracic imaging were analyzed to determine what constitutes effective and ineffective lecturing. Methods and Materials: Evaluations of sessions and individual speakers participating in a five-day course jointly sponsored by the Society of Thoracic Radiology (STR) and the Radiological Society of North America (RSNA) were tallied by the RSNA Department of Data Management and three members of the STR Training Committee. Comments were collated and analyzed to determine the number of positive and negative comments and common themes related to ineffective lecturing. Results: Twenty-two sessions were evaluated by 234 (75.7%) of 309 professional registrants. Eighty-one speakers were evaluated by an average of 153 registrants (range, 2 313). Mean ratings for 10 items evaluating sessions ranged from 1.28 2.05 (1=most positive, 4=least positive; SD .451 - .902). The average speaker rating was 5.7 (1=very poor, 7=outstanding; SD 0.94; range 4.3 6.4). Total number of comments analyzed was 862, with 505 (58.6%) considered positive and 404 (46.9%) considered negative (the total number exceeds 862 as a comment could consist of both positive and negative statements). Poor content was mentioned most frequently, making up 107 (26.5%) of 404 negative comments, and applied to 51 (63%) of 81 speakers. Other negative comments, in order of decreasing frequency, were related to delivery, image slides, command of the English language, text slides, and handouts. Conclusions: Individual evaluations of speakers at a national CME course provided information regarding the quality of lectures that was not provided by evaluations of grouped presentations. Systematic review of speaker evaluations provided specific information related to the types and frequency of features related to ineffective lecturing. This information can be used to design CME course evaluations, design future CME course outcomes studies, provide training to presenters, and monitor presenter performance.
first_indexed 2024-12-18T19:31:18Z
format Article
id doaj.art-74d2e487d7c54af2bdae7949a2d62eb6
institution Directory Open Access Journal
issn 1087-2981
language English
last_indexed 2024-12-18T19:31:18Z
publishDate 2002-12-01
publisher Taylor & Francis Group
record_format Article
series Medical Education Online
spelling doaj.art-74d2e487d7c54af2bdae7949a2d62eb62022-12-21T20:55:43ZengTaylor & Francis GroupMedical Education Online1087-29812002-12-01717Evaluation of Speakers at a National Continuing Medical Education (CME) CourseJannette Collins, MD, MEd, FCCPPurpose: Evaluations of a national radiology continuing medical education (CME) course in thoracic imaging were analyzed to determine what constitutes effective and ineffective lecturing. Methods and Materials: Evaluations of sessions and individual speakers participating in a five-day course jointly sponsored by the Society of Thoracic Radiology (STR) and the Radiological Society of North America (RSNA) were tallied by the RSNA Department of Data Management and three members of the STR Training Committee. Comments were collated and analyzed to determine the number of positive and negative comments and common themes related to ineffective lecturing. Results: Twenty-two sessions were evaluated by 234 (75.7%) of 309 professional registrants. Eighty-one speakers were evaluated by an average of 153 registrants (range, 2 313). Mean ratings for 10 items evaluating sessions ranged from 1.28 2.05 (1=most positive, 4=least positive; SD .451 - .902). The average speaker rating was 5.7 (1=very poor, 7=outstanding; SD 0.94; range 4.3 6.4). Total number of comments analyzed was 862, with 505 (58.6%) considered positive and 404 (46.9%) considered negative (the total number exceeds 862 as a comment could consist of both positive and negative statements). Poor content was mentioned most frequently, making up 107 (26.5%) of 404 negative comments, and applied to 51 (63%) of 81 speakers. Other negative comments, in order of decreasing frequency, were related to delivery, image slides, command of the English language, text slides, and handouts. Conclusions: Individual evaluations of speakers at a national CME course provided information regarding the quality of lectures that was not provided by evaluations of grouped presentations. Systematic review of speaker evaluations provided specific information related to the types and frequency of features related to ineffective lecturing. This information can be used to design CME course evaluations, design future CME course outcomes studies, provide training to presenters, and monitor presenter performance.http://www.med-ed-online.org/res00047.htmmedical educationhealth professional educationpeer-reviewedContinuing medical educationfaculty evaluation
spellingShingle Jannette Collins, MD, MEd, FCCP
Evaluation of Speakers at a National Continuing Medical Education (CME) Course
Medical Education Online
medical education
health professional education
peer-reviewed
Continuing medical education
faculty evaluation
title Evaluation of Speakers at a National Continuing Medical Education (CME) Course
title_full Evaluation of Speakers at a National Continuing Medical Education (CME) Course
title_fullStr Evaluation of Speakers at a National Continuing Medical Education (CME) Course
title_full_unstemmed Evaluation of Speakers at a National Continuing Medical Education (CME) Course
title_short Evaluation of Speakers at a National Continuing Medical Education (CME) Course
title_sort evaluation of speakers at a national continuing medical education cme course
topic medical education
health professional education
peer-reviewed
Continuing medical education
faculty evaluation
url http://www.med-ed-online.org/res00047.htm
work_keys_str_mv AT jannettecollinsmdmedfccp evaluationofspeakersatanationalcontinuingmedicaleducationcmecourse