User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts
Purpose: Although many interventional approaches have been proposed to address the apparent gap between novices and experts for literature review (LR) search tasks, there have been very few approaches proposed for manuscript preparation (MP) related tasks. This paper describes a task and an incumben...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2017
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/85539 http://hdl.handle.net/10220/43761 |
| _version_ | 1811697178856390656 |
|---|---|
| author | Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie |
| author2 | Lewandowski, Dirk |
| author_facet | Lewandowski, Dirk Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie |
| author_sort | Sesagiri Raamkumar, Aravind |
| collection | NTU |
| description | Purpose: Although many interventional approaches have been proposed to address the apparent gap between novices and experts for literature review (LR) search tasks, there have been very few approaches proposed for manuscript preparation (MP) related tasks. This paper describes a task and an incumbent technique for shortlisting important and unique papers from the reading list of researchers, meant for citation in a manuscript.
Design/methodology/approach: A user evaluation study was conducted on the prototype system which was built for supporting the shortlisting papers (SP) task along with two other LR search tasks. A total of 119 researchers who had experience in authoring research papers participated in this study. An online questionnaire was provided to the participants for evaluating the task. Both quantitative and qualitative analyses were performed on the collected evaluation data.
Findings: Graduate research students prefer this task more than research and academic staff. The evaluation measures relevance, usefulness and certainty were identified as predictors for the output quality measure ‘good list’. The shortlisting feature and information cues were the preferred aspects while limited dataset and rote steps in the study were ascertained as critical aspects from the qualitative feedback of the participants.
Originality/value: Findings point out that researchers are clearly interested in this novel task of shortlisting papers from the final reading list prepared during literature review. This has implications for digital library, academic databases and reference management software where this task can be included to benefit researchers at the manuscript preparatory stage of the research lifecycle. |
| first_indexed | 2024-10-01T07:51:08Z |
| format | Journal Article |
| id | ntu-10356/85539 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:51:08Z |
| publishDate | 2017 |
| record_format | dspace |
| spelling | ntu-10356/855392020-03-07T12:15:50Z User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie Lewandowski, Dirk Wee Kim Wee School of Communication and Information Manuscript preparation Shortlisting citations Purpose: Although many interventional approaches have been proposed to address the apparent gap between novices and experts for literature review (LR) search tasks, there have been very few approaches proposed for manuscript preparation (MP) related tasks. This paper describes a task and an incumbent technique for shortlisting important and unique papers from the reading list of researchers, meant for citation in a manuscript. Design/methodology/approach: A user evaluation study was conducted on the prototype system which was built for supporting the shortlisting papers (SP) task along with two other LR search tasks. A total of 119 researchers who had experience in authoring research papers participated in this study. An online questionnaire was provided to the participants for evaluating the task. Both quantitative and qualitative analyses were performed on the collected evaluation data. Findings: Graduate research students prefer this task more than research and academic staff. The evaluation measures relevance, usefulness and certainty were identified as predictors for the output quality measure ‘good list’. The shortlisting feature and information cues were the preferred aspects while limited dataset and rote steps in the study were ascertained as critical aspects from the qualitative feedback of the participants. Originality/value: Findings point out that researchers are clearly interested in this novel task of shortlisting papers from the final reading list prepared during literature review. This has implications for digital library, academic databases and reference management software where this task can be included to benefit researchers at the manuscript preparatory stage of the research lifecycle. NRF (Natl Research Foundation, S’pore) Accepted version 2017-09-18T05:40:13Z 2019-12-06T16:05:36Z 2017-09-18T05:40:13Z 2019-12-06T16:05:36Z 2017 Journal Article Sesagiri Raamkumar, A., Foo, S., & Pang, N. (2017). User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts. Aslib Journal of Information Management, in press. 2050-3806 https://hdl.handle.net/10356/85539 http://hdl.handle.net/10220/43761 10.1108/AJIM-01-2017-0020 en Aslib Journal of Information Management © 2017 Emerald. This is the author created version of a work that has been peer reviewed and accepted for publication by Aslib Journal of Information Management, Emerald. It incorporates referee’s comments but changes resulting from the publishing process, such as copyediting, structural formatting, may not be reflected in this document. The published version is available at: [http://dx.doi.org/10.1108/AJIM-01-2017-0020]. 24 p. application/pdf |
| spellingShingle | Manuscript preparation Shortlisting citations Sesagiri Raamkumar, Aravind Foo, Schubert Pang, Natalie User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts |
| title | User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts |
| title_full | User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts |
| title_fullStr | User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts |
| title_full_unstemmed | User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts |
| title_short | User evaluation of a task for shortlisting papers from researcher’s reading list for citing in manuscripts |
| title_sort | user evaluation of a task for shortlisting papers from researcher s reading list for citing in manuscripts |
| topic | Manuscript preparation Shortlisting citations |
| url | https://hdl.handle.net/10356/85539 http://hdl.handle.net/10220/43761 |
| work_keys_str_mv | AT sesagiriraamkumararavind userevaluationofataskforshortlistingpapersfromresearchersreadinglistforcitinginmanuscripts AT fooschubert userevaluationofataskforshortlistingpapersfromresearchersreadinglistforcitinginmanuscripts AT pangnatalie userevaluationofataskforshortlistingpapersfromresearchersreadinglistforcitinginmanuscripts |