Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians
Objective To compare evaluations of depressive episodes and suggested treatment protocols generated by Chat Generative Pretrained Transformer (ChatGPT)-3 and ChatGPT-4 with the recommendations of primary care physicians.Methods Vignettes were input to the ChatGPT interface. These vignettes focused p...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2023-10-01
|
| Series: | Family Medicine and Community Health |
| Online Access: | https://fmch.bmj.com/content/11/4/e002391.full |
| _version_ | 1797365911866310656 |
|---|---|
| author | Inbar Levkovich Zohar Elyoseph |
| author_facet | Inbar Levkovich Zohar Elyoseph |
| author_sort | Inbar Levkovich |
| collection | DOAJ |
| description | Objective To compare evaluations of depressive episodes and suggested treatment protocols generated by Chat Generative Pretrained Transformer (ChatGPT)-3 and ChatGPT-4 with the recommendations of primary care physicians.Methods Vignettes were input to the ChatGPT interface. These vignettes focused primarily on hypothetical patients with symptoms of depression during initial consultations. The creators of these vignettes meticulously designed eight distinct versions in which they systematically varied patient attributes (sex, socioeconomic status (blue collar worker or white collar worker) and depression severity (mild or severe)). Each variant was subsequently introduced into ChatGPT-3.5 and ChatGPT-4. Each vignette was repeated 10 times to ensure consistency and reliability of the ChatGPT responses.Results For mild depression, ChatGPT-3.5 and ChatGPT-4 recommended psychotherapy in 95.0% and 97.5% of cases, respectively. Primary care physicians, however, recommended psychotherapy in only 4.3% of cases. For severe cases, ChatGPT favoured an approach that combined psychotherapy, while primary care physicians recommended a combined approach. The pharmacological recommendations of ChatGPT-3.5 and ChatGPT-4 showed a preference for exclusive use of antidepressants (74% and 68%, respectively), in contrast with primary care physicians, who typically recommended a mix of antidepressants and anxiolytics/hypnotics (67.4%). Unlike primary care physicians, ChatGPT showed no gender or socioeconomic biases in its recommendations.Conclusion ChatGPT-3.5 and ChatGPT-4 aligned well with accepted guidelines for managing mild and severe depression, without showing the gender or socioeconomic biases observed among primary care physicians. Despite the suggested potential benefit of using atificial intelligence (AI) chatbots like ChatGPT to enhance clinical decision making, further research is needed to refine AI recommendations for severe cases and to consider potential risks and ethical issues. |
| first_indexed | 2024-03-08T16:55:41Z |
| format | Article |
| id | doaj.art-39517263df9f4b84ab3cbdc1d510b406 |
| institution | Directory Open Access Journal |
| issn | 2305-6983 2009-8774 |
| language | English |
| last_indexed | 2024-03-08T16:55:41Z |
| publishDate | 2023-10-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | Family Medicine and Community Health |
| spelling | doaj.art-39517263df9f4b84ab3cbdc1d510b4062024-01-05T01:55:08ZengBMJ Publishing GroupFamily Medicine and Community Health2305-69832009-87742023-10-0111410.1136/fmch-2023-002391Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physiciansInbar Levkovich0Zohar Elyoseph1Oranim Academic College, Tivon, IsraelDepartment of Psychology and Educational Counseling, Max Stern Academic College Of Emek Yezreel, Emek Yezreel, IsraelObjective To compare evaluations of depressive episodes and suggested treatment protocols generated by Chat Generative Pretrained Transformer (ChatGPT)-3 and ChatGPT-4 with the recommendations of primary care physicians.Methods Vignettes were input to the ChatGPT interface. These vignettes focused primarily on hypothetical patients with symptoms of depression during initial consultations. The creators of these vignettes meticulously designed eight distinct versions in which they systematically varied patient attributes (sex, socioeconomic status (blue collar worker or white collar worker) and depression severity (mild or severe)). Each variant was subsequently introduced into ChatGPT-3.5 and ChatGPT-4. Each vignette was repeated 10 times to ensure consistency and reliability of the ChatGPT responses.Results For mild depression, ChatGPT-3.5 and ChatGPT-4 recommended psychotherapy in 95.0% and 97.5% of cases, respectively. Primary care physicians, however, recommended psychotherapy in only 4.3% of cases. For severe cases, ChatGPT favoured an approach that combined psychotherapy, while primary care physicians recommended a combined approach. The pharmacological recommendations of ChatGPT-3.5 and ChatGPT-4 showed a preference for exclusive use of antidepressants (74% and 68%, respectively), in contrast with primary care physicians, who typically recommended a mix of antidepressants and anxiolytics/hypnotics (67.4%). Unlike primary care physicians, ChatGPT showed no gender or socioeconomic biases in its recommendations.Conclusion ChatGPT-3.5 and ChatGPT-4 aligned well with accepted guidelines for managing mild and severe depression, without showing the gender or socioeconomic biases observed among primary care physicians. Despite the suggested potential benefit of using atificial intelligence (AI) chatbots like ChatGPT to enhance clinical decision making, further research is needed to refine AI recommendations for severe cases and to consider potential risks and ethical issues.https://fmch.bmj.com/content/11/4/e002391.full |
| spellingShingle | Inbar Levkovich Zohar Elyoseph Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians Family Medicine and Community Health |
| title | Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians |
| title_full | Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians |
| title_fullStr | Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians |
| title_full_unstemmed | Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians |
| title_short | Identifying depression and its determinants upon initiating treatment: ChatGPT versus primary care physicians |
| title_sort | identifying depression and its determinants upon initiating treatment chatgpt versus primary care physicians |
| url | https://fmch.bmj.com/content/11/4/e002391.full |
| work_keys_str_mv | AT inbarlevkovich identifyingdepressionanditsdeterminantsuponinitiatingtreatmentchatgptversusprimarycarephysicians AT zoharelyoseph identifyingdepressionanditsdeterminantsuponinitiatingtreatmentchatgptversusprimarycarephysicians |