Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study
BACKGROUND: Patients' choices of providers when undergoing elective surgeries significantly impact both perioperative outcomes and costs. There exist a variety of approaches that are available to patients for evaluating between different hospital choices. OBJECTIVE: This paper aims to compare d...
| Main Authors: | , , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications Inc.
2021
|
| Online Access: | https://hdl.handle.net/1721.1/129462 |
| _version_ | 1826214585842008064 |
|---|---|
| author | Goyal, D Guttag, J Syed, Z Mehta, R Elahi, Z Saeed, M |
| author2 | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| author_facet | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Goyal, D Guttag, J Syed, Z Mehta, R Elahi, Z Saeed, M |
| author_sort | Goyal, D |
| collection | MIT |
| description | BACKGROUND: Patients' choices of providers when undergoing elective surgeries significantly impact both perioperative outcomes and costs. There exist a variety of approaches that are available to patients for evaluating between different hospital choices. OBJECTIVE: This paper aims to compare differences in outcomes and costs between hospitals ranked using popular internet-based consumer ratings, quality stars, reputation rankings, average volumes, average outcomes, and precision machine learning-based rankings for hospital settings performing hip replacements in a large metropolitan area. METHODS: Retrospective data from 4192 hip replacement surgeries among Medicare beneficiaries in 2018 in a the Chicago metropolitan area were analyzed for variations in outcomes (90-day postprocedure hospitalizations and emergency department visits) and costs (90-day total cost of care) between hospitals ranked through multiple approaches: internet-based consumer ratings, quality stars, reputation rankings, average yearly surgical volume, average outcome rates, and machine learning-based rankings. The average rates of outcomes and costs were compared between the patients who underwent surgery at a hospital using each ranking approach in unadjusted and propensity-based adjusted comparisons. RESULTS: Only a minority of patients (1159/4192, 27.6% to 2078/4192, 49.6%) were found to be matched to higher-ranked hospitals for each of the different approaches. Of the approaches considered, hip replacements at hospitals that were more highly ranked by consumer ratings, quality stars, and machine learning were all consistently associated with improvements in outcomes and costs in both adjusted and unadjusted analyses. The improvement was greatest across all metrics and analyses for machine learning-based rankings. CONCLUSIONS: There may be a substantive opportunity to increase the number of patients matched to appropriate hospitals across a broad variety of ranking approaches. Elective hip replacement surgeries performed at hospitals where patients were matched based on patient-specific machine learning were associated with better outcomes and lower total costs of care. |
| first_indexed | 2024-09-23T16:07:49Z |
| format | Article |
| id | mit-1721.1/129462 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2024-09-23T16:07:49Z |
| publishDate | 2021 |
| publisher | JMIR Publications Inc. |
| record_format | dspace |
| spelling | mit-1721.1/1294622024-06-25T23:54:07Z Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study Goyal, D Guttag, J Syed, Z Mehta, R Elahi, Z Saeed, M Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science BACKGROUND: Patients' choices of providers when undergoing elective surgeries significantly impact both perioperative outcomes and costs. There exist a variety of approaches that are available to patients for evaluating between different hospital choices. OBJECTIVE: This paper aims to compare differences in outcomes and costs between hospitals ranked using popular internet-based consumer ratings, quality stars, reputation rankings, average volumes, average outcomes, and precision machine learning-based rankings for hospital settings performing hip replacements in a large metropolitan area. METHODS: Retrospective data from 4192 hip replacement surgeries among Medicare beneficiaries in 2018 in a the Chicago metropolitan area were analyzed for variations in outcomes (90-day postprocedure hospitalizations and emergency department visits) and costs (90-day total cost of care) between hospitals ranked through multiple approaches: internet-based consumer ratings, quality stars, reputation rankings, average yearly surgical volume, average outcome rates, and machine learning-based rankings. The average rates of outcomes and costs were compared between the patients who underwent surgery at a hospital using each ranking approach in unadjusted and propensity-based adjusted comparisons. RESULTS: Only a minority of patients (1159/4192, 27.6% to 2078/4192, 49.6%) were found to be matched to higher-ranked hospitals for each of the different approaches. Of the approaches considered, hip replacements at hospitals that were more highly ranked by consumer ratings, quality stars, and machine learning were all consistently associated with improvements in outcomes and costs in both adjusted and unadjusted analyses. The improvement was greatest across all metrics and analyses for machine learning-based rankings. CONCLUSIONS: There may be a substantive opportunity to increase the number of patients matched to appropriate hospitals across a broad variety of ranking approaches. Elective hip replacement surgeries performed at hospitals where patients were matched based on patient-specific machine learning were associated with better outcomes and lower total costs of care. 2021-01-20T14:46:02Z 2021-01-20T14:46:02Z 2020-12 2020-12-16T18:23:52Z Article http://purl.org/eprint/type/JournalArticle 1438-8871 https://hdl.handle.net/1721.1/129462 Goyal, Dev et al. “Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study.” Journal of medical Internet research, 22, 12 (December 2020): e22765 © 2020 The Author(s) en 10.2196/22765 Journal of medical Internet research Creative Commons Attribution 4.0 International license https://creativecommons.org/licenses/by/4.0/ application/pdf JMIR Publications Inc. Journal of Medical Internet Research |
| spellingShingle | Goyal, D Guttag, J Syed, Z Mehta, R Elahi, Z Saeed, M Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study |
| title | Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study |
| title_full | Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study |
| title_fullStr | Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study |
| title_full_unstemmed | Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study |
| title_short | Comparing Precision Machine Learning With Consumer, Quality, and Volume Metrics for Ranking Orthopedic Surgery Hospitals: Retrospective Study |
| title_sort | comparing precision machine learning with consumer quality and volume metrics for ranking orthopedic surgery hospitals retrospective study |
| url | https://hdl.handle.net/1721.1/129462 |
| work_keys_str_mv | AT goyald comparingprecisionmachinelearningwithconsumerqualityandvolumemetricsforrankingorthopedicsurgeryhospitalsretrospectivestudy AT guttagj comparingprecisionmachinelearningwithconsumerqualityandvolumemetricsforrankingorthopedicsurgeryhospitalsretrospectivestudy AT syedz comparingprecisionmachinelearningwithconsumerqualityandvolumemetricsforrankingorthopedicsurgeryhospitalsretrospectivestudy AT mehtar comparingprecisionmachinelearningwithconsumerqualityandvolumemetricsforrankingorthopedicsurgeryhospitalsretrospectivestudy AT elahiz comparingprecisionmachinelearningwithconsumerqualityandvolumemetricsforrankingorthopedicsurgeryhospitalsretrospectivestudy AT saeedm comparingprecisionmachinelearningwithconsumerqualityandvolumemetricsforrankingorthopedicsurgeryhospitalsretrospectivestudy |