Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks
Purpose: Systems to support literature review (LR) and manuscript preparation tend to focus on only one or two of the tasks involved. The purpose of this paper is to describe an intervention framework that redesigns a particular set of tasks, allowing for interconnectivity between the tasks and prov...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2017
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/82820 http://hdl.handle.net/10220/42315 |
| _version_ | 1811685696981696512 |
|---|---|
| author | Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie |
| author2 | Wee Kim Wee School of Communication and Information |
| author_facet | Wee Kim Wee School of Communication and Information Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie |
| author_sort | Sesagiri Raamkumar, Aravind |
| collection | NTU |
| description | Purpose: Systems to support literature review (LR) and manuscript preparation tend to focus on only one or two of the tasks involved. The purpose of this paper is to describe an intervention framework that redesigns a particular set of tasks, allowing for interconnectivity between the tasks and providing appropriate user interface display features for each task in a prototype system. Design/methodology/approach: A user evaluation study was conducted on the prototype system. The system supports the three tasks: building a reading list (RL) of research papers, finding similar papers based on a set of papers and shortlisting papers from the final RL for inclusion in manuscript based on article type. A total of 119 researchers who had experience in authoring research papers, participated in the evaluation study. They had to select one of the provided 43 topics and execute the tasks offered by the system. Three questionnaires were provided for evaluating the tasks and system. Both quantitative and qualitative analyses were performed on the collected evaluation data. Findings: Task redesign aspects had a positive impact in user evaluation for the second task of finding similar papers while improvement was found to be required for the first and third tasks. The tasks interconnectivity features seed basket and RL were helpful for the participants in conveniently searching for papers within the system. Two of the four proposed informational display features, namely, information cue labels and shared co-relations were the most preferred features of the system. Student user group found the task recommendations and the overall system to be more useful and effective than the staff group. Originality/value: This study validates the importance of interconnected task design and novel informational display features in accentuating task-based recommendations for LR and manuscript preparatory tasks. The potential for improvement in recommendations was shown through the task redesign exercise where new requirements for the tasks were identified. The resultant prototype system helps in bridging the gap between novices and experts in terms of LR skills. |
| first_indexed | 2024-10-01T04:48:38Z |
| format | Journal Article |
| id | ntu-10356/82820 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T04:48:38Z |
| publishDate | 2017 |
| record_format | dspace |
| spelling | ntu-10356/828202020-03-07T12:15:49Z Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie Wee Kim Wee School of Communication and Information Literature review Digital library Purpose: Systems to support literature review (LR) and manuscript preparation tend to focus on only one or two of the tasks involved. The purpose of this paper is to describe an intervention framework that redesigns a particular set of tasks, allowing for interconnectivity between the tasks and providing appropriate user interface display features for each task in a prototype system. Design/methodology/approach: A user evaluation study was conducted on the prototype system. The system supports the three tasks: building a reading list (RL) of research papers, finding similar papers based on a set of papers and shortlisting papers from the final RL for inclusion in manuscript based on article type. A total of 119 researchers who had experience in authoring research papers, participated in the evaluation study. They had to select one of the provided 43 topics and execute the tasks offered by the system. Three questionnaires were provided for evaluating the tasks and system. Both quantitative and qualitative analyses were performed on the collected evaluation data. Findings: Task redesign aspects had a positive impact in user evaluation for the second task of finding similar papers while improvement was found to be required for the first and third tasks. The tasks interconnectivity features seed basket and RL were helpful for the participants in conveniently searching for papers within the system. Two of the four proposed informational display features, namely, information cue labels and shared co-relations were the most preferred features of the system. Student user group found the task recommendations and the overall system to be more useful and effective than the staff group. Originality/value: This study validates the importance of interconnected task design and novel informational display features in accentuating task-based recommendations for LR and manuscript preparatory tasks. The potential for improvement in recommendations was shown through the task redesign exercise where new requirements for the tasks were identified. The resultant prototype system helps in bridging the gap between novices and experts in terms of LR skills. NRF (Natl Research Foundation, S’pore) Accepted version 2017-05-03T06:14:37Z 2019-12-06T15:06:17Z 2017-05-03T06:14:37Z 2019-12-06T15:06:17Z 2017 Journal Article Sesagiri Raamkumar, A., Foo, S., & Pang, N. (2017). Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks. Journal of Documentation, 73(3), 555-580. 0022-0418 https://hdl.handle.net/10356/82820 http://hdl.handle.net/10220/42315 10.1108/JD-06-2016-0072 en Journal of Documentation © 2017 Emerald Publishing Limited. This is the author created version of a work that has been peer reviewed and accepted for publication by Journal of Documentation, Emerald Publishing Limited. It incorporates referee’s comments but changes resulting from the publishing process, such as copyediting, structural formatting, may not be reflected in this document. The published version is available at: [http://dx.doi.org/10.1108/JD-06-2016-0072]. 30 p. application/pdf |
| spellingShingle | Literature review Digital library Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks |
| title | Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks |
| title_full | Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks |
| title_fullStr | Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks |
| title_full_unstemmed | Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks |
| title_short | Evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks |
| title_sort | evaluating a threefold intervention framework for assisting researchers in literature review and manuscript preparatory tasks |
| topic | Literature review Digital library |
| url | https://hdl.handle.net/10356/82820 http://hdl.handle.net/10220/42315 |
| work_keys_str_mv | AT sesagiriraamkumararavind evaluatingathreefoldinterventionframeworkforassistingresearchersinliteraturereviewandmanuscriptpreparatorytasks AT fooschubert evaluatingathreefoldinterventionframeworkforassistingresearchersinliteraturereviewandmanuscriptpreparatorytasks AT pangnatalie evaluatingathreefoldinterventionframeworkforassistingresearchersinliteraturereviewandmanuscriptpreparatorytasks |