ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions
Introduction Administrative and reimbursement data from the Austrian health care system is linked and utilized for research and to support policy makers. Lacking standardized, reliable and systematic coding of diagnoses in the outpatient sector, statistical and machine learning models are developed...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Swansea University
2019-11-01
|
| Series: | International Journal of Population Data Science |
| Online Access: | https://ijpds.org/article/view/1314 |
| _version_ | 1797423879741767680 |
|---|---|
| author | Florian Endel Nadine Weibrecht |
| author_facet | Florian Endel Nadine Weibrecht |
| author_sort | Florian Endel |
| collection | DOAJ |
| description | Introduction
Administrative and reimbursement data from the Austrian health care system is linked and utilized for research and to support policy makers. Lacking standardized, reliable and systematic coding of diagnoses in the outpatient sector, statistical and machine learning models are developed to estimate individual diagnoses coded as ICD-10 based on filled prescriptions (ATC codes), hence called “ATC->ICD models”.
Evaluating the performance of such models, presenting predictions on a global as well as individual level, comparing different technological approaches and establishing trust by providing an intuitive insight into results for non-technical users are the aim of this project.
Method
ATC->ICD models are presented utilizing interactive web interfaces based on the R shiny package. As one size does not fit all, customized applications are required for different models and points of view. Applying modularization of reoccurring functionality and retaining design principles like a common dashboard layout facilitates the development and training of users. Software containers and centralized infrastructure providing e.g. backup, encryption and authentication enables efficient deployment of new application and their maintenance.
Results
We developed interactive web-based dashboards enabling experts to explore the prediction of single ATC->ICD models and compare the output of different approaches. The possibility to export and annotate results allows us to collect expert opinions, enhance understanding and gain acceptance conveniently. The combination of various dynamic controls, e.g. to filter, search, sort and cluster results, provides flexible access to complex models and large datasets. Linked and interactive graphs and tables help to understand valid and identify erroneous results much faster than with raw output and printed reports.
Conclusion
Presenting ATC->ICD models renders them accessible to data scientists and domain experts. It allows us to collect valuable feedback and gain trust in complex, hard to understand methodologies and results. |
| first_indexed | 2024-03-09T07:53:09Z |
| format | Article |
| id | doaj.art-f4d8a967ee0a45d596c38ee1e5c320d0 |
| institution | Directory Open Access Journal |
| issn | 2399-4908 |
| language | English |
| last_indexed | 2024-03-09T07:53:09Z |
| publishDate | 2019-11-01 |
| publisher | Swansea University |
| record_format | Article |
| series | International Journal of Population Data Science |
| spelling | doaj.art-f4d8a967ee0a45d596c38ee1e5c320d02023-12-03T01:25:36ZengSwansea UniversityInternational Journal of Population Data Science2399-49082019-11-014310.23889/ijpds.v4i3.1314ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictionsFlorian Endel0Nadine Weibrecht1TU Wien, dexhelppdexhelppIntroduction Administrative and reimbursement data from the Austrian health care system is linked and utilized for research and to support policy makers. Lacking standardized, reliable and systematic coding of diagnoses in the outpatient sector, statistical and machine learning models are developed to estimate individual diagnoses coded as ICD-10 based on filled prescriptions (ATC codes), hence called “ATC->ICD models”. Evaluating the performance of such models, presenting predictions on a global as well as individual level, comparing different technological approaches and establishing trust by providing an intuitive insight into results for non-technical users are the aim of this project. Method ATC->ICD models are presented utilizing interactive web interfaces based on the R shiny package. As one size does not fit all, customized applications are required for different models and points of view. Applying modularization of reoccurring functionality and retaining design principles like a common dashboard layout facilitates the development and training of users. Software containers and centralized infrastructure providing e.g. backup, encryption and authentication enables efficient deployment of new application and their maintenance. Results We developed interactive web-based dashboards enabling experts to explore the prediction of single ATC->ICD models and compare the output of different approaches. The possibility to export and annotate results allows us to collect expert opinions, enhance understanding and gain acceptance conveniently. The combination of various dynamic controls, e.g. to filter, search, sort and cluster results, provides flexible access to complex models and large datasets. Linked and interactive graphs and tables help to understand valid and identify erroneous results much faster than with raw output and printed reports. Conclusion Presenting ATC->ICD models renders them accessible to data scientists and domain experts. It allows us to collect valuable feedback and gain trust in complex, hard to understand methodologies and results.https://ijpds.org/article/view/1314 |
| spellingShingle | Florian Endel Nadine Weibrecht ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions International Journal of Population Data Science |
| title | ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions |
| title_full | ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions |
| title_fullStr | ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions |
| title_full_unstemmed | ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions |
| title_short | ATC-ICD: enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions |
| title_sort | atc icd enabling domain experts to explore and evaluate machine learning models estimating diagnoses from filled predictions |
| url | https://ijpds.org/article/view/1314 |
| work_keys_str_mv | AT florianendel atcicdenablingdomainexpertstoexploreandevaluatemachinelearningmodelsestimatingdiagnosesfromfilledpredictions AT nadineweibrecht atcicdenablingdomainexpertstoexploreandevaluatemachinelearningmodelsestimatingdiagnosesfromfilledpredictions |