A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study
BackgroundConcern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2021-07-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2021/7/e24436 |
| _version_ | 1827859145281241088 |
|---|---|
| author | Naae Lee Seung-Won Oh Belong Cho Seung-Kwon Myung Seung-Sik Hwang Goo Hyeon Yoon |
| author_facet | Naae Lee Seung-Won Oh Belong Cho Seung-Kwon Myung Seung-Sik Hwang Goo Hyeon Yoon |
| author_sort | Naae Lee |
| collection | DOAJ |
| description |
BackgroundConcern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers.
ObjectiveThis study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles.
MethodsWe reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation.
ResultsOverall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69).
ConclusionsWe developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea. |
| first_indexed | 2024-03-12T13:04:08Z |
| format | Article |
| id | doaj.art-2ed0ea48ed3f4cfab57e3b5ed27afa5a |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-03-12T13:04:08Z |
| publishDate | 2021-07-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-2ed0ea48ed3f4cfab57e3b5ed27afa5a2023-08-28T17:10:04ZengJMIR PublicationsJournal of Medical Internet Research1438-88712021-07-01237e2443610.2196/24436A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development StudyNaae Leehttps://orcid.org/0000-0002-2829-1079Seung-Won Ohhttps://orcid.org/0000-0003-3800-0754Belong Chohttps://orcid.org/0000-0001-9558-689XSeung-Kwon Myunghttps://orcid.org/0000-0001-8911-1345Seung-Sik Hwanghttps://orcid.org/0000-0002-1558-7831Goo Hyeon Yoonhttps://orcid.org/0000-0001-8184-7884 BackgroundConcern regarding the reliability and accuracy of the health-related information provided by online newspaper articles has increased. Numerous criteria and items have been proposed and published regarding the quality assessment of online information, but there is no standard quality assessment tool available for online newspapers. ObjectiveThis study aimed to develop the Health Information Quality Assessment Tool (HIQUAL) for online newspaper articles. MethodsWe reviewed previous health information quality assessment tools and related studies and accordingly developed and customized new criteria. The interrater agreement for the new assessment tool was assessed for 3 newspaper articles on different subjects (colorectal cancer, obesity genetic testing, and hypertension diagnostic criteria) using the Fleiss κ and Gwet agreement coefficient. To compare the quality scores generated by each pair of tools, convergent validity was measured using the Kendall τ ranked correlation. ResultsOverall, the HIQUAL for newspaper articles comprised 10 items across 5 domains: reliability, usefulness, understandability, sufficiency, and transparency. The interrater agreement for the article on colorectal cancer was in the moderate to substantial range (Fleiss κ=0.48, SE 0.11; Gwet agreement coefficient=0.74, SE 0.13), while for the article introducing obesity genetic testing it was in the substantial range, with values of 0.63 (SE 0.28) and 0.86 (SE 0.10) for the two measures, respectively. There was relatively low agreement for the article on hypertension diagnostic criteria at 0.20 (SE 0.10) and 0.75 (SE 0.13), respectively. Validity of the correlation assessed with the Kendall τ showed good correlation between tools (HIQUAL vs DISCERN=0.72, HIQUAL vs QUEST [Quality Evaluation Scoring Tool]=0.69). ConclusionsWe developed a new assessment tool to evaluate the quality of health information in online newspaper articles, to help consumers discern accurate sources of health information. The HIQUAL can help increase the accuracy and quality of online health information in Korea.https://www.jmir.org/2021/7/e24436 |
| spellingShingle | Naae Lee Seung-Won Oh Belong Cho Seung-Kwon Myung Seung-Sik Hwang Goo Hyeon Yoon A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study Journal of Medical Internet Research |
| title | A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study |
| title_full | A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study |
| title_fullStr | A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study |
| title_full_unstemmed | A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study |
| title_short | A Health Information Quality Assessment Tool for Korean Online Newspaper Articles: Development Study |
| title_sort | health information quality assessment tool for korean online newspaper articles development study |
| url | https://www.jmir.org/2021/7/e24436 |
| work_keys_str_mv | AT naaelee ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT seungwonoh ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT belongcho ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT seungkwonmyung ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT seungsikhwang ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT goohyeonyoon ahealthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT naaelee healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT seungwonoh healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT belongcho healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT seungkwonmyung healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT seungsikhwang healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy AT goohyeonyoon healthinformationqualityassessmenttoolforkoreanonlinenewspaperarticlesdevelopmentstudy |