shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using R
In this paper, we introduce shinyReCoR: a new app that utilizes a cluster-based method for automatically coding open-ended text responses. Reliable coding of text responses from educational or psychological assessments requires substantial organizational and human effort. The coding of natural langu...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-08-01
|
| Series: | Psych |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2624-8611/3/3/30 |
| _version_ | 1797517409251229696 |
|---|---|
| author | Nico Andersen Fabian Zehner |
| author_facet | Nico Andersen Fabian Zehner |
| author_sort | Nico Andersen |
| collection | DOAJ |
| description | In this paper, we introduce shinyReCoR: a new app that utilizes a cluster-based method for automatically coding open-ended text responses. Reliable coding of text responses from educational or psychological assessments requires substantial organizational and human effort. The coding of natural language in responses to tests depends on the texts’ complexity, corresponding coding guides, and the guides’ quality. Manual coding is thus not only expensive but also error-prone. With shinyReCoR, we provide a more efficient alternative. The use of natural language processing makes texts utilizable for statistical methods. shinyReCoR is a Shiny app deployed as an R-package that allows users with varying technical affinity to create automatic response classifiers through a graphical user interface based on annotated data. The present paper describes the underlying methodology, including machine learning, as well as peculiarities of the processing of language in the assessment context. The app guides users through the workflow with steps like text corpus compilation, semantic space building, preprocessing of the text data, and clustering. Users can adjust each step according to their needs. Finally, users are provided with an automatic response classifier, which can be evaluated and tested within the process. |
| first_indexed | 2024-03-10T07:16:13Z |
| format | Article |
| id | doaj.art-39eeb948275044bcb42879dd5b56ba02 |
| institution | Directory Open Access Journal |
| issn | 2624-8611 |
| language | English |
| last_indexed | 2024-03-10T07:16:13Z |
| publishDate | 2021-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Psych |
| spelling | doaj.art-39eeb948275044bcb42879dd5b56ba022023-11-22T15:01:22ZengMDPI AGPsych2624-86112021-08-013342244610.3390/psych3030030shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using RNico Andersen0Fabian Zehner1Leibniz Institute for Research and Information in Education (DIPF), 60323 Frankfurt, GermanyLeibniz Institute for Research and Information in Education (DIPF), 60323 Frankfurt, GermanyIn this paper, we introduce shinyReCoR: a new app that utilizes a cluster-based method for automatically coding open-ended text responses. Reliable coding of text responses from educational or psychological assessments requires substantial organizational and human effort. The coding of natural language in responses to tests depends on the texts’ complexity, corresponding coding guides, and the guides’ quality. Manual coding is thus not only expensive but also error-prone. With shinyReCoR, we provide a more efficient alternative. The use of natural language processing makes texts utilizable for statistical methods. shinyReCoR is a Shiny app deployed as an R-package that allows users with varying technical affinity to create automatic response classifiers through a graphical user interface based on annotated data. The present paper describes the underlying methodology, including machine learning, as well as peculiarities of the processing of language in the assessment context. The app guides users through the workflow with steps like text corpus compilation, semantic space building, preprocessing of the text data, and clustering. Users can adjust each step according to their needs. Finally, users are provided with an automatic response classifier, which can be evaluated and tested within the process.https://www.mdpi.com/2624-8611/3/3/30automatic response codingRshinynatural language processingmachine learningvisualization |
| spellingShingle | Nico Andersen Fabian Zehner shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using R Psych automatic response coding R shiny natural language processing machine learning visualization |
| title | shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using R |
| title_full | shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using R |
| title_fullStr | shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using R |
| title_full_unstemmed | shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using R |
| title_short | shinyReCoR: A Shiny Application for Automatically Coding Text Responses Using R |
| title_sort | shinyrecor a shiny application for automatically coding text responses using r |
| topic | automatic response coding R shiny natural language processing machine learning visualization |
| url | https://www.mdpi.com/2624-8611/3/3/30 |
| work_keys_str_mv | AT nicoandersen shinyrecorashinyapplicationforautomaticallycodingtextresponsesusingr AT fabianzehner shinyrecorashinyapplicationforautomaticallycodingtextresponsesusingr |