ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction
Purpose: To determine whether ChatGPT effectively responds to 10 commonly asked questions concerning ulnar collateral ligament (UCL) reconstruction. Methods: A comprehensive list of 90 UCL reconstruction questions was initially created, with a final set of 10 “most commonly asked” questions ultimate...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-04-01
|
| Series: | Arthroscopy, Sports Medicine, and Rehabilitation |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2666061X24000117 |
| _version_ | 1797311527894646784 |
|---|---|
| author | William L. Johns, M.D. Alec Kellish, M.D. Dominic Farronato, B.S. Michael G. Ciccotti, M.D. Sommer Hammoud, M.D. |
| author_facet | William L. Johns, M.D. Alec Kellish, M.D. Dominic Farronato, B.S. Michael G. Ciccotti, M.D. Sommer Hammoud, M.D. |
| author_sort | William L. Johns, M.D. |
| collection | DOAJ |
| description | Purpose: To determine whether ChatGPT effectively responds to 10 commonly asked questions concerning ulnar collateral ligament (UCL) reconstruction. Methods: A comprehensive list of 90 UCL reconstruction questions was initially created, with a final set of 10 “most commonly asked” questions ultimately selected. Questions were presented to ChatGPT and its response was documented. Responses were evaluated independently by 3 authors using an evidence-based methodology, resulting in a grading system categorized as follows: (1) excellent response not requiring clarification; (2) satisfactory requiring minimal clarification; (3) satisfactory requiring moderate clarification; and (4) unsatisfactory requiring substantial clarification. Results: Six of 10 ten responses were rated as “excellent” or “satisfactory.” Of those 6 responses, 2 were determined to be “excellent response not requiring clarification,” 3 were “satisfactory requiring minimal clarification,” and 1 was “satisfactory requiring moderate clarification.” Four questions encompassing inquiries about “What are the potential risks of UCL reconstruction surgery?” “Which type of graft should be used for my UCL reconstruction?” and “Should I have UCL reconstruction or repair?” were rated as “unsatisfactory requiring substantial clarification.” Conclusions: ChatGPT exhibited the potential to improve a patient’s basic understanding of UCL reconstruction and provided responses that were deemed satisfactory to excellent for 60% of the most commonly asked questions. For the other 40% of questions, ChatGPT gave unsatisfactory responses, primarily due to a lack of relevant details or the need for further explanation. Clinical Relevance: ChatGPT can assist in patient education regarding UCL reconstruction; however, its ability to appropriately answer more complex questions remains to be an area of skepticism and future improvement. |
| first_indexed | 2024-03-08T02:01:02Z |
| format | Article |
| id | doaj.art-9c7eb46e4f354a4199d5589e52e96fad |
| institution | Directory Open Access Journal |
| issn | 2666-061X |
| language | English |
| last_indexed | 2024-03-08T02:01:02Z |
| publishDate | 2024-04-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Arthroscopy, Sports Medicine, and Rehabilitation |
| spelling | doaj.art-9c7eb46e4f354a4199d5589e52e96fad2024-02-14T05:18:53ZengElsevierArthroscopy, Sports Medicine, and Rehabilitation2666-061X2024-04-0162100893ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament ReconstructionWilliam L. Johns, M.D.0Alec Kellish, M.D.1Dominic Farronato, B.S.2Michael G. Ciccotti, M.D.3Sommer Hammoud, M.D.4Rothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.Rothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.Rothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.Rothman Orthopaedic Institute at Thomas Jefferson University, Philadelphia, Pennsylvania, U.S.A.; Address correspondence to Sommer Hammoud, M.D., Department of Orthopaedic Surgery at The Rothman Institute at Thomas Jefferson University.Purpose: To determine whether ChatGPT effectively responds to 10 commonly asked questions concerning ulnar collateral ligament (UCL) reconstruction. Methods: A comprehensive list of 90 UCL reconstruction questions was initially created, with a final set of 10 “most commonly asked” questions ultimately selected. Questions were presented to ChatGPT and its response was documented. Responses were evaluated independently by 3 authors using an evidence-based methodology, resulting in a grading system categorized as follows: (1) excellent response not requiring clarification; (2) satisfactory requiring minimal clarification; (3) satisfactory requiring moderate clarification; and (4) unsatisfactory requiring substantial clarification. Results: Six of 10 ten responses were rated as “excellent” or “satisfactory.” Of those 6 responses, 2 were determined to be “excellent response not requiring clarification,” 3 were “satisfactory requiring minimal clarification,” and 1 was “satisfactory requiring moderate clarification.” Four questions encompassing inquiries about “What are the potential risks of UCL reconstruction surgery?” “Which type of graft should be used for my UCL reconstruction?” and “Should I have UCL reconstruction or repair?” were rated as “unsatisfactory requiring substantial clarification.” Conclusions: ChatGPT exhibited the potential to improve a patient’s basic understanding of UCL reconstruction and provided responses that were deemed satisfactory to excellent for 60% of the most commonly asked questions. For the other 40% of questions, ChatGPT gave unsatisfactory responses, primarily due to a lack of relevant details or the need for further explanation. Clinical Relevance: ChatGPT can assist in patient education regarding UCL reconstruction; however, its ability to appropriately answer more complex questions remains to be an area of skepticism and future improvement.http://www.sciencedirect.com/science/article/pii/S2666061X24000117 |
| spellingShingle | William L. Johns, M.D. Alec Kellish, M.D. Dominic Farronato, B.S. Michael G. Ciccotti, M.D. Sommer Hammoud, M.D. ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction Arthroscopy, Sports Medicine, and Rehabilitation |
| title | ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction |
| title_full | ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction |
| title_fullStr | ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction |
| title_full_unstemmed | ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction |
| title_short | ChatGPT Can Offer Satisfactory Responses to Common Patient Questions Regarding Elbow Ulnar Collateral Ligament Reconstruction |
| title_sort | chatgpt can offer satisfactory responses to common patient questions regarding elbow ulnar collateral ligament reconstruction |
| url | http://www.sciencedirect.com/science/article/pii/S2666061X24000117 |
| work_keys_str_mv | AT williamljohnsmd chatgptcanoffersatisfactoryresponsestocommonpatientquestionsregardingelbowulnarcollateralligamentreconstruction AT aleckellishmd chatgptcanoffersatisfactoryresponsestocommonpatientquestionsregardingelbowulnarcollateralligamentreconstruction AT dominicfarronatobs chatgptcanoffersatisfactoryresponsestocommonpatientquestionsregardingelbowulnarcollateralligamentreconstruction AT michaelgciccottimd chatgptcanoffersatisfactoryresponsestocommonpatientquestionsregardingelbowulnarcollateralligamentreconstruction AT sommerhammoudmd chatgptcanoffersatisfactoryresponsestocommonpatientquestionsregardingelbowulnarcollateralligamentreconstruction |