Validation of the Story World Absorption Scale through annotation of online book reviews
In this paper we present our attempt at validating a self-report instrument developed in the field of empirical literary studies to capture absorption experiences, namely the Story World Absorption Scale (SWAS, Kuijpers, et al. 2014). We used the SWAS as the foundation for a tag set, that targets me...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Department of Languages, Literatures, and Cultures at McGill University
2024-03-01
|
| Series: | Journal of Cultural Analytics |
| Online Access: | https://doi.org/10.22148/001c.92531 |
| _version_ | 1797214569159983104 |
|---|---|
| author | Moniek M. Kuijpers Massimo Lusetti Piroska Lendvai Simone Rebora |
| author_facet | Moniek M. Kuijpers Massimo Lusetti Piroska Lendvai Simone Rebora |
| author_sort | Moniek M. Kuijpers |
| collection | DOAJ |
| description | In this paper we present our attempt at validating a self-report instrument developed in the field of empirical literary studies to capture absorption experiences, namely the Story World Absorption Scale (SWAS, Kuijpers, et al. 2014). We used the SWAS as the foundation for a tag set, that targets mentions of absorption in online book reviews. Online book reviews posted on social media platforms are a relatively new form of reader testimonials that can be of use to researchers from different disciplines to investigate reading experience and evaluation, as well as social discourse about reading. This paper discusses the annotation tag set, which was developed through an iterative process, presented alongside a series of inter-annotator agreement studies that show the validity of our annotation process. Finally, it will discuss the validation and reconceptualization of the Story World Absorption construct, where we consider instances of systematic disagreement during annotation and discuss new categories that we added to the tag set that indicate areas where absorption theory may need to be refined. |
| first_indexed | 2024-03-07T16:28:43Z |
| format | Article |
| id | doaj.art-98944a1e73c746c0a2dc6e891e755a76 |
| institution | Directory Open Access Journal |
| issn | 2371-4549 |
| language | English |
| last_indexed | 2024-04-24T11:16:15Z |
| publishDate | 2024-03-01 |
| publisher | Department of Languages, Literatures, and Cultures at McGill University |
| record_format | Article |
| series | Journal of Cultural Analytics |
| spelling | doaj.art-98944a1e73c746c0a2dc6e891e755a762024-04-11T07:40:19ZengDepartment of Languages, Literatures, and Cultures at McGill UniversityJournal of Cultural Analytics2371-45492024-03-0191Validation of the Story World Absorption Scale through annotation of online book reviewsMoniek M. KuijpersMassimo LusettiPiroska LendvaiSimone ReboraIn this paper we present our attempt at validating a self-report instrument developed in the field of empirical literary studies to capture absorption experiences, namely the Story World Absorption Scale (SWAS, Kuijpers, et al. 2014). We used the SWAS as the foundation for a tag set, that targets mentions of absorption in online book reviews. Online book reviews posted on social media platforms are a relatively new form of reader testimonials that can be of use to researchers from different disciplines to investigate reading experience and evaluation, as well as social discourse about reading. This paper discusses the annotation tag set, which was developed through an iterative process, presented alongside a series of inter-annotator agreement studies that show the validity of our annotation process. Finally, it will discuss the validation and reconceptualization of the Story World Absorption construct, where we consider instances of systematic disagreement during annotation and discuss new categories that we added to the tag set that indicate areas where absorption theory may need to be refined.https://doi.org/10.22148/001c.92531 |
| spellingShingle | Moniek M. Kuijpers Massimo Lusetti Piroska Lendvai Simone Rebora Validation of the Story World Absorption Scale through annotation of online book reviews Journal of Cultural Analytics |
| title | Validation of the Story World Absorption Scale through annotation of online book reviews |
| title_full | Validation of the Story World Absorption Scale through annotation of online book reviews |
| title_fullStr | Validation of the Story World Absorption Scale through annotation of online book reviews |
| title_full_unstemmed | Validation of the Story World Absorption Scale through annotation of online book reviews |
| title_short | Validation of the Story World Absorption Scale through annotation of online book reviews |
| title_sort | validation of the story world absorption scale through annotation of online book reviews |
| url | https://doi.org/10.22148/001c.92531 |
| work_keys_str_mv | AT moniekmkuijpers validationofthestoryworldabsorptionscalethroughannotationofonlinebookreviews AT massimolusetti validationofthestoryworldabsorptionscalethroughannotationofonlinebookreviews AT piroskalendvai validationofthestoryworldabsorptionscalethroughannotationofonlinebookreviews AT simonerebora validationofthestoryworldabsorptionscalethroughannotationofonlinebookreviews |