Use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers
With breakthroughs in Natural Language Processing and Artificial Intelligence (AI), the usage of Large Language Models (LLMs) in academic research has increased tremendously. Models such as Generative Pre-trained Transformer (GPT) are used by researchers in literature review, abstract screening, and...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Nature Research
2024
|
| _version_ | 1824458764643729408 |
|---|---|
| author | Mishra, T Sutanto, E Rossanti, R Pant, N Ashraf, A Raut, A Uwabareze, G Oluwatomiwa, A Zeeshan, B |
| author_facet | Mishra, T Sutanto, E Rossanti, R Pant, N Ashraf, A Raut, A Uwabareze, G Oluwatomiwa, A Zeeshan, B |
| author_sort | Mishra, T |
| collection | OXFORD |
| description | With breakthroughs in Natural Language Processing and Artificial Intelligence (AI), the usage of Large Language Models (LLMs) in academic research has increased tremendously. Models such as Generative Pre-trained Transformer (GPT) are used by researchers in literature review, abstract screening, and manuscript drafting. However, these models also present the attendant challenge of providing ethically questionable scientific information. Our study provides a snapshot of global researchers’ perception of current trends and future impacts of LLMs in research. Using a cross-sectional design, we surveyed 226 medical and paramedical researchers from 59 countries across 65 specialties, trained in the Global Clinical Scholars’ Research Training certificate program of Harvard Medical School between 2020 and 2024. Majority (57.5%) of these participants practiced in an academic setting with a median of 7 (2,18) PubMed Indexed published articles. 198 respondents (87.6%) were aware of LLMs and those who were aware had higher number of publications (p < 0.001). 18.7% of the respondents who were aware (n = 37) had previously used LLMs in publications especially for grammatical errors and formatting (64.9%); however, most (40.5%) did not acknowledge its use in their papers. 50.8% of aware respondents (n = 95) predicted an overall positive future impact of LLMs while 32.6% were unsure of its scope. 52% of aware respondents (n = 102) believed that LLMs would have a major impact in areas such as grammatical errors and formatting (66.3%), revision and editing (57.2%), writing (57.2%) and literature review (54.2%). 58.1% of aware respondents were opined that journals should allow for use of AI in research and 78.3% believed that regulations should be put in place to avoid its abuse. Seeing the perception of researchers towards LLMs and the significant association between awareness of LLMs and number of published works, we emphasize the importance of developing comprehensive guidelines and ethical framework to govern the use of AI in academic research and address the current challenges. |
| first_indexed | 2025-02-19T04:31:05Z |
| format | Journal article |
| id | oxford-uuid:18960ba1-8f2e-4a23-a878-4610e6310592 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2025-02-19T04:31:05Z |
| publishDate | 2024 |
| publisher | Nature Research |
| record_format | dspace |
| spelling | oxford-uuid:18960ba1-8f2e-4a23-a878-4610e63105922025-01-08T20:03:43ZUse of large language models as artificial intelligence tools in academic research and publishing among global clinical researchersJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:18960ba1-8f2e-4a23-a878-4610e6310592EnglishJisc Publications RouterNature Research2024Mishra, TSutanto, ERossanti, RPant, NAshraf, ARaut, AUwabareze, GOluwatomiwa, AZeeshan, BWith breakthroughs in Natural Language Processing and Artificial Intelligence (AI), the usage of Large Language Models (LLMs) in academic research has increased tremendously. Models such as Generative Pre-trained Transformer (GPT) are used by researchers in literature review, abstract screening, and manuscript drafting. However, these models also present the attendant challenge of providing ethically questionable scientific information. Our study provides a snapshot of global researchers’ perception of current trends and future impacts of LLMs in research. Using a cross-sectional design, we surveyed 226 medical and paramedical researchers from 59 countries across 65 specialties, trained in the Global Clinical Scholars’ Research Training certificate program of Harvard Medical School between 2020 and 2024. Majority (57.5%) of these participants practiced in an academic setting with a median of 7 (2,18) PubMed Indexed published articles. 198 respondents (87.6%) were aware of LLMs and those who were aware had higher number of publications (p < 0.001). 18.7% of the respondents who were aware (n = 37) had previously used LLMs in publications especially for grammatical errors and formatting (64.9%); however, most (40.5%) did not acknowledge its use in their papers. 50.8% of aware respondents (n = 95) predicted an overall positive future impact of LLMs while 32.6% were unsure of its scope. 52% of aware respondents (n = 102) believed that LLMs would have a major impact in areas such as grammatical errors and formatting (66.3%), revision and editing (57.2%), writing (57.2%) and literature review (54.2%). 58.1% of aware respondents were opined that journals should allow for use of AI in research and 78.3% believed that regulations should be put in place to avoid its abuse. Seeing the perception of researchers towards LLMs and the significant association between awareness of LLMs and number of published works, we emphasize the importance of developing comprehensive guidelines and ethical framework to govern the use of AI in academic research and address the current challenges. |
| spellingShingle | Mishra, T Sutanto, E Rossanti, R Pant, N Ashraf, A Raut, A Uwabareze, G Oluwatomiwa, A Zeeshan, B Use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers |
| title | Use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers |
| title_full | Use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers |
| title_fullStr | Use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers |
| title_full_unstemmed | Use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers |
| title_short | Use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers |
| title_sort | use of large language models as artificial intelligence tools in academic research and publishing among global clinical researchers |
| work_keys_str_mv | AT mishrat useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT sutantoe useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT rossantir useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT pantn useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT ashrafa useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT rauta useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT uwabarezeg useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT oluwatomiwaa useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers AT zeeshanb useoflargelanguagemodelsasartificialintelligencetoolsinacademicresearchandpublishingamongglobalclinicalresearchers |