Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders

Abstract Background Data on resource use are frequently required for healthcare assessments. Studies on healthcare utilization (HCU) in individuals with mental disorders have analyzed both self-reports and administrative data. Source of data may affect the quality of analysis and compromise the accu...

Celý popis

Podrobná bibliografie
Hlavní autoři: Tarcyane Barata Garcia, Roman Kliemt, Franziska Claus, Anne Neumann, Bettina Soltmann, Fabian Baum, Julian Schwarz, Enno Swart, Jochen Schmitt, Andrea Pfennig, Dennis Häckl, Ines Weinhold
Médium: Článek
Jazyk:English
Vydáno: BMC 2023-11-01
Edice:BMC Health Services Research
Témata:
On-line přístup:https://doi.org/10.1186/s12913-023-10175-6
_version_ 1827764573968531456
author Tarcyane Barata Garcia
Roman Kliemt
Franziska Claus
Anne Neumann
Bettina Soltmann
Fabian Baum
Julian Schwarz
Enno Swart
Jochen Schmitt
Andrea Pfennig
Dennis Häckl
Ines Weinhold
author_facet Tarcyane Barata Garcia
Roman Kliemt
Franziska Claus
Anne Neumann
Bettina Soltmann
Fabian Baum
Julian Schwarz
Enno Swart
Jochen Schmitt
Andrea Pfennig
Dennis Häckl
Ines Weinhold
author_sort Tarcyane Barata Garcia
collection DOAJ
description Abstract Background Data on resource use are frequently required for healthcare assessments. Studies on healthcare utilization (HCU) in individuals with mental disorders have analyzed both self-reports and administrative data. Source of data may affect the quality of analysis and compromise the accuracy of results. We sought to ascertain the degree of agreement between self-reports and statutory health insurance (SHI) fund claims data from patients with mental disorders. Methods Claims data from six German SHI and self-reports were obtained along with a cost-effectiveness analysis performed as a part of a controlled prospective multicenter cohort study conducted in 18 psychiatric hospitals in Germany (PsychCare), including patients with pre-defined psychiatric disorders. Self-reports were collected using the German adaption of the Client Sociodemographic and Service Receipt Inventory (CSSRI) questionnaire with a 6-month recall period. Data linkage was performed using a unique pseudonymized identifier. Missing responses were coded as non-use for all analyses. HCU was calculated for inpatient and outpatient care, day-care services, home treatment, and pharmaceuticals. Concordance was measured using Cohen’s Kappa (κ) and intraclass correlation coefficient (ICC). Regression approaches were used to investigate the effect of independent variables on the agreements. Results In total 274 participants (mean age 47.8 [SD = 14.2] years; 47.08% women) were included in the analysis. No significant differences were observed between the linked and unlinked patients in terms of baseline characteristics. Total agreements values were 63.9% (κ = 0.03; PABAK = 0.28) for outpatient contacts, 69.3% (κ = 0.25; PABAK = 0.39) for medication use, 81.0% (κ = 0.56; PABAK = 0.62) for inpatient days and 86.1% (κ = 0.67; PABAK = 0.72) for day-care services. There was varied quantitative agreement between data sources, with the poorest agreement for outpatient care (ICC [95% CI] = 0.22 [0.10–0.33]) and the best for psychiatric day-care services (ICC [95% CI] = 0.72 [0.66–0.78]). Marital status and time since first treatment positively affected the chance of agreement on utilization of outpatient services. Conclusions Although there were high levels of absolute agreement, the measures of concordance between administrative records and self-reports were generally minimal to moderate. Healthcare investigations should consider using linked or at least different data sources to estimate HCU for specific utilization areas, where unbiased information can be expected. Trial registration This study was part of the multi-center controlled PsychCare trial (German Clinical Trials Register No. DRKS00022535; Date of registration: 2020–10-02).
first_indexed 2024-03-11T11:06:28Z
format Article
id doaj.art-5280beaf77f14330a5fecdb6a94e958c
institution Directory Open Access Journal
issn 1472-6963
language English
last_indexed 2024-03-11T11:06:28Z
publishDate 2023-11-01
publisher BMC
record_format Article
series BMC Health Services Research
spelling doaj.art-5280beaf77f14330a5fecdb6a94e958c2023-11-12T12:11:27ZengBMCBMC Health Services Research1472-69632023-11-0123111410.1186/s12913-023-10175-6Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disordersTarcyane Barata Garcia0Roman Kliemt1Franziska Claus2Anne Neumann3Bettina Soltmann4Fabian Baum5Julian Schwarz6Enno Swart7Jochen Schmitt8Andrea Pfennig9Dennis Häckl10Ines Weinhold11WIG2 Institute for Health Economics and Health System ResearchWIG2 Institute for Health Economics and Health System ResearchWIG2 Institute for Health Economics and Health System ResearchCenter of Evidence-Based Health Care, Medizinische Fakultät Carl Gustav Carus, Technische Universität DresdenDepartment of Psychiatry and Psychotherapy, Universitätsklinikum Und Medizinische Fakultät Carl Gustav Carus, Technische Universität DresdenCenter of Evidence-Based Health Care, Medizinische Fakultät Carl Gustav Carus, Technische Universität DresdenBrandenburg Medical School, University Clinic for Psychiatry and Psychotherapy, Immanuel Hospital RüdersdorfInstitute of Social Medicine and Health Systems Research, Medical Faculty, Otto-Von-Guericke- University MagdeburgCenter of Evidence-Based Health Care, Medizinische Fakultät Carl Gustav Carus, Technische Universität DresdenDepartment of Psychiatry and Psychotherapy, Universitätsklinikum Und Medizinische Fakultät Carl Gustav Carus, Technische Universität DresdenWIG2 Institute for Health Economics and Health System ResearchWIG2 Institute for Health Economics and Health System ResearchAbstract Background Data on resource use are frequently required for healthcare assessments. Studies on healthcare utilization (HCU) in individuals with mental disorders have analyzed both self-reports and administrative data. Source of data may affect the quality of analysis and compromise the accuracy of results. We sought to ascertain the degree of agreement between self-reports and statutory health insurance (SHI) fund claims data from patients with mental disorders. Methods Claims data from six German SHI and self-reports were obtained along with a cost-effectiveness analysis performed as a part of a controlled prospective multicenter cohort study conducted in 18 psychiatric hospitals in Germany (PsychCare), including patients with pre-defined psychiatric disorders. Self-reports were collected using the German adaption of the Client Sociodemographic and Service Receipt Inventory (CSSRI) questionnaire with a 6-month recall period. Data linkage was performed using a unique pseudonymized identifier. Missing responses were coded as non-use for all analyses. HCU was calculated for inpatient and outpatient care, day-care services, home treatment, and pharmaceuticals. Concordance was measured using Cohen’s Kappa (κ) and intraclass correlation coefficient (ICC). Regression approaches were used to investigate the effect of independent variables on the agreements. Results In total 274 participants (mean age 47.8 [SD = 14.2] years; 47.08% women) were included in the analysis. No significant differences were observed between the linked and unlinked patients in terms of baseline characteristics. Total agreements values were 63.9% (κ = 0.03; PABAK = 0.28) for outpatient contacts, 69.3% (κ = 0.25; PABAK = 0.39) for medication use, 81.0% (κ = 0.56; PABAK = 0.62) for inpatient days and 86.1% (κ = 0.67; PABAK = 0.72) for day-care services. There was varied quantitative agreement between data sources, with the poorest agreement for outpatient care (ICC [95% CI] = 0.22 [0.10–0.33]) and the best for psychiatric day-care services (ICC [95% CI] = 0.72 [0.66–0.78]). Marital status and time since first treatment positively affected the chance of agreement on utilization of outpatient services. Conclusions Although there were high levels of absolute agreement, the measures of concordance between administrative records and self-reports were generally minimal to moderate. Healthcare investigations should consider using linked or at least different data sources to estimate HCU for specific utilization areas, where unbiased information can be expected. Trial registration This study was part of the multi-center controlled PsychCare trial (German Clinical Trials Register No. DRKS00022535; Date of registration: 2020–10-02).https://doi.org/10.1186/s12913-023-10175-6Mental healthSelf-reportData linkageAdministrative dataAgreement
spellingShingle Tarcyane Barata Garcia
Roman Kliemt
Franziska Claus
Anne Neumann
Bettina Soltmann
Fabian Baum
Julian Schwarz
Enno Swart
Jochen Schmitt
Andrea Pfennig
Dennis Häckl
Ines Weinhold
Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders
BMC Health Services Research
Mental health
Self-report
Data linkage
Administrative data
Agreement
title Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders
title_full Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders
title_fullStr Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders
title_full_unstemmed Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders
title_short Agreement between self-reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders
title_sort agreement between self reports and statutory health insurance claims data on healthcare utilization in patients with mental disorders
topic Mental health
Self-report
Data linkage
Administrative data
Agreement
url https://doi.org/10.1186/s12913-023-10175-6
work_keys_str_mv AT tarcyanebaratagarcia agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT romankliemt agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT franziskaclaus agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT anneneumann agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT bettinasoltmann agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT fabianbaum agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT julianschwarz agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT ennoswart agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT jochenschmitt agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT andreapfennig agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT dennishackl agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders
AT inesweinhold agreementbetweenselfreportsandstatutoryhealthinsuranceclaimsdataonhealthcareutilizationinpatientswithmentaldisorders