Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study
Abstract Summary of Findings (SoF) tables concisely present the main findings of evidence synthesis of health evidence, but how users navigate it to understand and interpret the presented information is not clear. We quantified the interaction of medical students with an SoF table while answering a...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-10-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-023-45359-x |
| _version_ | 1797560145574625280 |
|---|---|
| author | Jakov Matas Ružica Tokalić Daniel García-Costa Emilia López-Iñesta Elena Álvarez-García Francisco Grimaldo Ana Marušić |
| author_facet | Jakov Matas Ružica Tokalić Daniel García-Costa Emilia López-Iñesta Elena Álvarez-García Francisco Grimaldo Ana Marušić |
| author_sort | Jakov Matas |
| collection | DOAJ |
| description | Abstract Summary of Findings (SoF) tables concisely present the main findings of evidence synthesis of health evidence, but how users navigate it to understand and interpret the presented information is not clear. We quantified the interaction of medical students with an SoF table while answering a knowledge quiz. Read&Learn tool was used to measure the number of target and non-target table cells visited for each question and the time spent on these cells. Students positively identified target elements for quiz questions and answered simpler questions, but struggled with critical thinking and understanding study outcomes. The question on outcomes with the largest improvement post-intervention had the fewest correct answers, the longest interaction with table cells and the most opened cells before answering. Students spent a median of 72% of the time reading target table cells. A heatmap of the interactions showed that they were mostly answer-oriented. Further development of the tool and metrics is needed to use the tool and the metrics to study the cognitive processes during the assessment of health evidence. |
| first_indexed | 2024-03-10T17:55:12Z |
| format | Article |
| id | doaj.art-cbdce99338f84b2098f861478ee95900 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-03-10T17:55:12Z |
| publishDate | 2023-10-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-cbdce99338f84b2098f861478ee959002023-11-20T09:12:42ZengNature PortfolioScientific Reports2045-23222023-10-011311910.1038/s41598-023-45359-xTool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional studyJakov Matas0Ružica Tokalić1Daniel García-Costa2Emilia López-Iñesta3Elena Álvarez-García4Francisco Grimaldo5Ana Marušić6Department of Research in Biomedicine and Health, Center for Evidence-Based Medicine, University of Split School of MedicineDepartment of Research in Biomedicine and Health, Center for Evidence-Based Medicine, University of Split School of MedicineComputer Science Department, Universitat de ValènciaDepartment of Didactics of Mathematics, Universitat de ValènciaComputer Science Department, Universitat de ValènciaComputer Science Department, Universitat de ValènciaDepartment of Research in Biomedicine and Health, Center for Evidence-Based Medicine, University of Split School of MedicineAbstract Summary of Findings (SoF) tables concisely present the main findings of evidence synthesis of health evidence, but how users navigate it to understand and interpret the presented information is not clear. We quantified the interaction of medical students with an SoF table while answering a knowledge quiz. Read&Learn tool was used to measure the number of target and non-target table cells visited for each question and the time spent on these cells. Students positively identified target elements for quiz questions and answered simpler questions, but struggled with critical thinking and understanding study outcomes. The question on outcomes with the largest improvement post-intervention had the fewest correct answers, the longest interaction with table cells and the most opened cells before answering. Students spent a median of 72% of the time reading target table cells. A heatmap of the interactions showed that they were mostly answer-oriented. Further development of the tool and metrics is needed to use the tool and the metrics to study the cognitive processes during the assessment of health evidence.https://doi.org/10.1038/s41598-023-45359-x |
| spellingShingle | Jakov Matas Ružica Tokalić Daniel García-Costa Emilia López-Iñesta Elena Álvarez-García Francisco Grimaldo Ana Marušić Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study Scientific Reports |
| title | Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study |
| title_full | Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study |
| title_fullStr | Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study |
| title_full_unstemmed | Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study |
| title_short | Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study |
| title_sort | tool to assess recognition and understanding of elements in summary of findings table for health evidence synthesis a cross sectional study |
| url | https://doi.org/10.1038/s41598-023-45359-x |
| work_keys_str_mv | AT jakovmatas tooltoassessrecognitionandunderstandingofelementsinsummaryoffindingstableforhealthevidencesynthesisacrosssectionalstudy AT ruzicatokalic tooltoassessrecognitionandunderstandingofelementsinsummaryoffindingstableforhealthevidencesynthesisacrosssectionalstudy AT danielgarciacosta tooltoassessrecognitionandunderstandingofelementsinsummaryoffindingstableforhealthevidencesynthesisacrosssectionalstudy AT emilialopezinesta tooltoassessrecognitionandunderstandingofelementsinsummaryoffindingstableforhealthevidencesynthesisacrosssectionalstudy AT elenaalvarezgarcia tooltoassessrecognitionandunderstandingofelementsinsummaryoffindingstableforhealthevidencesynthesisacrosssectionalstudy AT franciscogrimaldo tooltoassessrecognitionandunderstandingofelementsinsummaryoffindingstableforhealthevidencesynthesisacrosssectionalstudy AT anamarusic tooltoassessrecognitionandunderstandingofelementsinsummaryoffindingstableforhealthevidencesynthesisacrosssectionalstudy |