Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in India
Background: Assessment drives learning is a well-known adage. If the assessment is subjective, it can under/overestimate the student's performance and thus impair the learning process. Rubrics help standardize the assessment by giving guidelines to both the assessor and the student and minimize...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wolters Kluwer Medknow Publications
2023-01-01
|
| Series: | Journal of Indian Association of Public Health Dentistry |
| Subjects: | |
| Online Access: | http://www.jiaphd.org/article.asp?issn=2319-5932;year=2023;volume=21;issue=1;spage=76;epage=81;aulast=Krishnappa |
| _version_ | 1797775469315096576 |
|---|---|
| author | Pushpanjali Krishnappa Jyotsna Sriranga K M Shwetha Anitha R Sagarkar Aabha Singh |
| author_facet | Pushpanjali Krishnappa Jyotsna Sriranga K M Shwetha Anitha R Sagarkar Aabha Singh |
| author_sort | Pushpanjali Krishnappa |
| collection | DOAJ |
| description | Background: Assessment drives learning is a well-known adage. If the assessment is subjective, it can under/overestimate the student's performance and thus impair the learning process. Rubrics help standardize the assessment by giving guidelines to both the assessor and the student and minimize subjectivity. Methodology: A mixed method design was employed to identify the inter- and intra-rater reliability of assessing narrative reports and explore the faculty perceptions on using rubrics for the assessment of narrative reports. Results: The inter-rater reliability scores were 0.08 without the use of rubrics and 0.93 with the use of rubrics demonstrating a statistically significant-excellent reliability when rubrics were used. The intra- and inter-examiner mean total assessment scores showed a statistically significant variation when rubrics were not used while the variation was reduced with the use of rubric. The two examiners who were part of the study welcomed the use of rubrics for assessment. They concurred that rubrics gave the assessor the schema and minimized the subjectivity of the assessment. Although the time taken for assessment was initially longer with a rubric scale, subsequently, the time taken was reduced. The assessors felt that they were now in a position to give richer constructive feedback to students. They felt that the students should also know the rubric scale beforehand so that it sets the expectations and helps the student to set self-determined learning goals. Conclusion: The use of rubrics improves inter- and intra-rater reliability of assessment scores. It gives a direction to the examiners and helps categorizing the student performance with minimal subjectivity. |
| first_indexed | 2024-03-12T22:37:09Z |
| format | Article |
| id | doaj.art-1fd873d216234b98959a2ab32dafaa7c |
| institution | Directory Open Access Journal |
| issn | 2319-5932 2350-0484 |
| language | English |
| last_indexed | 2024-03-12T22:37:09Z |
| publishDate | 2023-01-01 |
| publisher | Wolters Kluwer Medknow Publications |
| record_format | Article |
| series | Journal of Indian Association of Public Health Dentistry |
| spelling | doaj.art-1fd873d216234b98959a2ab32dafaa7c2023-07-21T11:43:56ZengWolters Kluwer Medknow PublicationsJournal of Indian Association of Public Health Dentistry2319-59322350-04842023-01-01211768110.4103/jiaphd.jiaphd_76_22Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in IndiaPushpanjali KrishnappaJyotsna SrirangaK M ShwethaAnitha R SagarkarAabha SinghBackground: Assessment drives learning is a well-known adage. If the assessment is subjective, it can under/overestimate the student's performance and thus impair the learning process. Rubrics help standardize the assessment by giving guidelines to both the assessor and the student and minimize subjectivity. Methodology: A mixed method design was employed to identify the inter- and intra-rater reliability of assessing narrative reports and explore the faculty perceptions on using rubrics for the assessment of narrative reports. Results: The inter-rater reliability scores were 0.08 without the use of rubrics and 0.93 with the use of rubrics demonstrating a statistically significant-excellent reliability when rubrics were used. The intra- and inter-examiner mean total assessment scores showed a statistically significant variation when rubrics were not used while the variation was reduced with the use of rubric. The two examiners who were part of the study welcomed the use of rubrics for assessment. They concurred that rubrics gave the assessor the schema and minimized the subjectivity of the assessment. Although the time taken for assessment was initially longer with a rubric scale, subsequently, the time taken was reduced. The assessors felt that they were now in a position to give richer constructive feedback to students. They felt that the students should also know the rubric scale beforehand so that it sets the expectations and helps the student to set self-determined learning goals. Conclusion: The use of rubrics improves inter- and intra-rater reliability of assessment scores. It gives a direction to the examiners and helps categorizing the student performance with minimal subjectivity.http://www.jiaphd.org/article.asp?issn=2319-5932;year=2023;volume=21;issue=1;spage=76;epage=81;aulast=Krishnappaexaminer reliabilityperformance assessmentrubrics |
| spellingShingle | Pushpanjali Krishnappa Jyotsna Sriranga K M Shwetha Anitha R Sagarkar Aabha Singh Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in India Journal of Indian Association of Public Health Dentistry examiner reliability performance assessment rubrics |
| title | Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in India |
| title_full | Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in India |
| title_fullStr | Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in India |
| title_full_unstemmed | Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in India |
| title_short | Faculty experience and reliability of assessing narrative reports using rubrics: Report from a dental school in India |
| title_sort | faculty experience and reliability of assessing narrative reports using rubrics report from a dental school in india |
| topic | examiner reliability performance assessment rubrics |
| url | http://www.jiaphd.org/article.asp?issn=2319-5932;year=2023;volume=21;issue=1;spage=76;epage=81;aulast=Krishnappa |
| work_keys_str_mv | AT pushpanjalikrishnappa facultyexperienceandreliabilityofassessingnarrativereportsusingrubricsreportfromadentalschoolinindia AT jyotsnasriranga facultyexperienceandreliabilityofassessingnarrativereportsusingrubricsreportfromadentalschoolinindia AT kmshwetha facultyexperienceandreliabilityofassessingnarrativereportsusingrubricsreportfromadentalschoolinindia AT anitharsagarkar facultyexperienceandreliabilityofassessingnarrativereportsusingrubricsreportfromadentalschoolinindia AT aabhasingh facultyexperienceandreliabilityofassessingnarrativereportsusingrubricsreportfromadentalschoolinindia |