Using topic modeling to understand comments in student evaluations of teaching
Abstract Written comments in student evaluations of teaching offer a rich source of data for understanding instructors’ teaching and students’ learning experiences. However, most previous studies on student evaluations of teaching have focused on numeric ratings of close-ended questions, while few s...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer
2023-08-01
|
| Series: | Discover Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1007/s44217-023-00051-0 |
| _version_ | 1797451765682012160 |
|---|---|
| author | Jie Sun Lu Yan |
| author_facet | Jie Sun Lu Yan |
| author_sort | Jie Sun |
| collection | DOAJ |
| description | Abstract Written comments in student evaluations of teaching offer a rich source of data for understanding instructors’ teaching and students’ learning experiences. However, most previous studies on student evaluations of teaching have focused on numeric ratings of close-ended questions, while few studies have tried to analyze the content of students’ written comments on open-ended questions, which normally involves a labor-intensive manual process of coding and categorizing. Such qualitative efforts prevent solutions on a large scale since it is almost impossible to go through all the textual data manually. Therefore, an innovative quantitative method that can analyze a large corpus of data holds great promise. This paper proposes the latent Dirichlet allocation (LDA) method of topic modeling to discover important themes that emerge in students’ written comments. We compare our results with findings in previous qualitative studies. We also investigate how these themes vary by course grade level and course subject. Our results provide evidence that topic modeling can be an effective and efficient alternative for understanding teaching and learning experiences through students’ written comments on a large scale. |
| first_indexed | 2024-03-09T14:59:08Z |
| format | Article |
| id | doaj.art-7d50a0f7130b468dab0fb01dc81cd673 |
| institution | Directory Open Access Journal |
| issn | 2731-5525 |
| language | English |
| last_indexed | 2024-03-09T14:59:08Z |
| publishDate | 2023-08-01 |
| publisher | Springer |
| record_format | Article |
| series | Discover Education |
| spelling | doaj.art-7d50a0f7130b468dab0fb01dc81cd6732023-11-26T14:01:08ZengSpringerDiscover Education2731-55252023-08-012111210.1007/s44217-023-00051-0Using topic modeling to understand comments in student evaluations of teachingJie Sun0Lu Yan1Dean’s Office of Dedman College, Southern Methodist UniversityDepartment of Ethnic Studies, Minnesota State UniversityAbstract Written comments in student evaluations of teaching offer a rich source of data for understanding instructors’ teaching and students’ learning experiences. However, most previous studies on student evaluations of teaching have focused on numeric ratings of close-ended questions, while few studies have tried to analyze the content of students’ written comments on open-ended questions, which normally involves a labor-intensive manual process of coding and categorizing. Such qualitative efforts prevent solutions on a large scale since it is almost impossible to go through all the textual data manually. Therefore, an innovative quantitative method that can analyze a large corpus of data holds great promise. This paper proposes the latent Dirichlet allocation (LDA) method of topic modeling to discover important themes that emerge in students’ written comments. We compare our results with findings in previous qualitative studies. We also investigate how these themes vary by course grade level and course subject. Our results provide evidence that topic modeling can be an effective and efficient alternative for understanding teaching and learning experiences through students’ written comments on a large scale.https://doi.org/10.1007/s44217-023-00051-0Student evaluations of teachingStudents’ written commentsContent analysisTopic modelingText miningLDA |
| spellingShingle | Jie Sun Lu Yan Using topic modeling to understand comments in student evaluations of teaching Discover Education Student evaluations of teaching Students’ written comments Content analysis Topic modeling Text mining LDA |
| title | Using topic modeling to understand comments in student evaluations of teaching |
| title_full | Using topic modeling to understand comments in student evaluations of teaching |
| title_fullStr | Using topic modeling to understand comments in student evaluations of teaching |
| title_full_unstemmed | Using topic modeling to understand comments in student evaluations of teaching |
| title_short | Using topic modeling to understand comments in student evaluations of teaching |
| title_sort | using topic modeling to understand comments in student evaluations of teaching |
| topic | Student evaluations of teaching Students’ written comments Content analysis Topic modeling Text mining LDA |
| url | https://doi.org/10.1007/s44217-023-00051-0 |
| work_keys_str_mv | AT jiesun usingtopicmodelingtounderstandcommentsinstudentevaluationsofteaching AT luyan usingtopicmodelingtounderstandcommentsinstudentevaluationsofteaching |