Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational Study
BackgroundHay fever is a highly prevalent, heterogenous, and multifactorial disease. Patients may benefit from longitudinal assessments using mobile health (mHealth) principles. We have previously attempted to establish an effective mHealth platform for patients with hay feve...
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2022-08-01
|
| Series: | JMIR Formative Research |
| Online Access: | https://formative.jmir.org/2022/8/e38475 |
| _version_ | 1827858044765077504 |
|---|---|
| author | Yasutsugu Akasaki Takenori Inomata Jaemyoung Sung Yuichi Okumura Kenta Fujio Maria Miura Kunihiko Hirosawa Masao Iwagami Masahiro Nakamura Nobuyuki Ebihara Masahiro Nakamura Takuma Ide Ken Nagino Akira Murakami |
| author_facet | Yasutsugu Akasaki Takenori Inomata Jaemyoung Sung Yuichi Okumura Kenta Fujio Maria Miura Kunihiko Hirosawa Masao Iwagami Masahiro Nakamura Nobuyuki Ebihara Masahiro Nakamura Takuma Ide Ken Nagino Akira Murakami |
| author_sort | Yasutsugu Akasaki |
| collection | DOAJ |
| description |
BackgroundHay fever is a highly prevalent, heterogenous, and multifactorial disease. Patients may benefit from longitudinal assessments using mobile health (mHealth) principles. We have previously attempted to establish an effective mHealth platform for patients with hay fever through AllerSearch, our in-house smartphone app that assesses electronic patient-reported outcomes through a questionnaire on hay fever and provides evidence-based advice. To be used by the public, an investigation on its reliability and validity is necessary.
ObjectiveThe aim of this paper is to assess the reliability and validity of subjective symptom data on hay fever collected through our app, AllerSearch.
MethodsThis study used a prospective observational design. The participants were patients aged ≥20 years recruited from a single university hospital between June 2, 2021, and January 26, 2022. We excluded patients who could not use smartphones as well as those with incomplete data records and outlier data. All participants answered the Japanese Allergic Conjunctival Disease Standard Quality of Life Questionnaire (JACQLQ), first in the paper-and-pencil format and subsequently on AllerSearch on the same day. The JACQLQ comprises the following three domains: Domain I, with 9 items on ocular or nasal symptoms; Domain II, with 17 items on daily activity and psychological well-being; and Domain III, with 3 items on overall condition by face score. The concordance rate of each domain between the 2 platforms was calculated. The internal consistency of Domains I and II of the 2 platforms was assessed using Cronbach alpha coefficients, the concurrent validity of Domains I and II was assessed by calculating Pearson correlation coefficients, and the mean differences between the 2 platforms were assessed using Bland-Altman analysis.
ResultsIn total, 22 participants were recruited; the data of 20 (91%) participants were analyzed. The average age was 65.4 (SD 12.8) years, and 80% (16/20) of the participants were women. The concordance rate of Domains I, II, and III between the paper-based and app-based JACQLQ was 0.78, 0.85, and 0.90, respectively. The internal consistency of Domains I and II between the 2 platforms was satisfactory (Cronbach alpha of .964 and .919, respectively). Pearson correlation analysis yielded a significant positive correlation between Domains I and II across the 2 platforms (r=0.920 and r=0.968, respectively). The mean difference in Domains I and II between the 2 platforms was 3.35 units (95% limits of agreement: –6.51 to 13.2).
ConclusionsOur findings indicate that AllerSearch is a valid and reliable tool for the collection of electronic patient-reported outcomes to assess hay fever, contributing to the advantages of the mHealth platform. |
| first_indexed | 2024-03-12T12:49:10Z |
| format | Article |
| id | doaj.art-129438c293b9450bbbd4834d86eb70b2 |
| institution | Directory Open Access Journal |
| issn | 2561-326X |
| language | English |
| last_indexed | 2024-03-12T12:49:10Z |
| publishDate | 2022-08-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Formative Research |
| spelling | doaj.art-129438c293b9450bbbd4834d86eb70b22023-08-28T22:56:00ZengJMIR PublicationsJMIR Formative Research2561-326X2022-08-0168e3847510.2196/38475Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational StudyYasutsugu Akasakihttps://orcid.org/0000-0001-9527-0115Takenori Inomatahttps://orcid.org/0000-0003-3435-1055Jaemyoung Sunghttps://orcid.org/0000-0002-9441-3687Yuichi Okumurahttps://orcid.org/0000-0002-5521-5469Kenta Fujiohttps://orcid.org/0000-0002-8472-0800Maria Miurahttps://orcid.org/0000-0002-2600-2085Kunihiko Hirosawahttps://orcid.org/0000-0001-6775-3697Masao Iwagamihttps://orcid.org/0000-0001-7079-0640Masahiro Nakamurahttps://orcid.org/0000-0002-4363-069XNobuyuki Ebiharahttps://orcid.org/0000-0002-6772-6549Masahiro Nakamurahttps://orcid.org/0000-0001-5710-4458Takuma Idehttps://orcid.org/0000-0001-8204-5808Ken Naginohttps://orcid.org/0000-0002-0317-6074Akira Murakamihttps://orcid.org/0000-0002-0022-2514 BackgroundHay fever is a highly prevalent, heterogenous, and multifactorial disease. Patients may benefit from longitudinal assessments using mobile health (mHealth) principles. We have previously attempted to establish an effective mHealth platform for patients with hay fever through AllerSearch, our in-house smartphone app that assesses electronic patient-reported outcomes through a questionnaire on hay fever and provides evidence-based advice. To be used by the public, an investigation on its reliability and validity is necessary. ObjectiveThe aim of this paper is to assess the reliability and validity of subjective symptom data on hay fever collected through our app, AllerSearch. MethodsThis study used a prospective observational design. The participants were patients aged ≥20 years recruited from a single university hospital between June 2, 2021, and January 26, 2022. We excluded patients who could not use smartphones as well as those with incomplete data records and outlier data. All participants answered the Japanese Allergic Conjunctival Disease Standard Quality of Life Questionnaire (JACQLQ), first in the paper-and-pencil format and subsequently on AllerSearch on the same day. The JACQLQ comprises the following three domains: Domain I, with 9 items on ocular or nasal symptoms; Domain II, with 17 items on daily activity and psychological well-being; and Domain III, with 3 items on overall condition by face score. The concordance rate of each domain between the 2 platforms was calculated. The internal consistency of Domains I and II of the 2 platforms was assessed using Cronbach alpha coefficients, the concurrent validity of Domains I and II was assessed by calculating Pearson correlation coefficients, and the mean differences between the 2 platforms were assessed using Bland-Altman analysis. ResultsIn total, 22 participants were recruited; the data of 20 (91%) participants were analyzed. The average age was 65.4 (SD 12.8) years, and 80% (16/20) of the participants were women. The concordance rate of Domains I, II, and III between the paper-based and app-based JACQLQ was 0.78, 0.85, and 0.90, respectively. The internal consistency of Domains I and II between the 2 platforms was satisfactory (Cronbach alpha of .964 and .919, respectively). Pearson correlation analysis yielded a significant positive correlation between Domains I and II across the 2 platforms (r=0.920 and r=0.968, respectively). The mean difference in Domains I and II between the 2 platforms was 3.35 units (95% limits of agreement: –6.51 to 13.2). ConclusionsOur findings indicate that AllerSearch is a valid and reliable tool for the collection of electronic patient-reported outcomes to assess hay fever, contributing to the advantages of the mHealth platform.https://formative.jmir.org/2022/8/e38475 |
| spellingShingle | Yasutsugu Akasaki Takenori Inomata Jaemyoung Sung Yuichi Okumura Kenta Fujio Maria Miura Kunihiko Hirosawa Masao Iwagami Masahiro Nakamura Nobuyuki Ebihara Masahiro Nakamura Takuma Ide Ken Nagino Akira Murakami Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational Study JMIR Formative Research |
| title | Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational Study |
| title_full | Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational Study |
| title_fullStr | Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational Study |
| title_full_unstemmed | Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational Study |
| title_short | Reliability and Validity of Electronic Patient-Reported Outcomes Using the Smartphone App AllerSearch for Hay Fever: Prospective Observational Study |
| title_sort | reliability and validity of electronic patient reported outcomes using the smartphone app allersearch for hay fever prospective observational study |
| url | https://formative.jmir.org/2022/8/e38475 |
| work_keys_str_mv | AT yasutsuguakasaki reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT takenoriinomata reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT jaemyoungsung reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT yuichiokumura reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT kentafujio reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT mariamiura reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT kunihikohirosawa reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT masaoiwagami reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT masahironakamura reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT nobuyukiebihara reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT masahironakamura reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT takumaide reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT kennagino reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy AT akiramurakami reliabilityandvalidityofelectronicpatientreportedoutcomesusingthesmartphoneappallersearchforhayfeverprospectiveobservationalstudy |