Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis

Objectives: To determine the extent and content of academic publishers’ and scientific journals’ guidance for authors on the use of generative artificial intelligence (GAI). Design: Cross sectional, bibliometric study. Setting: Websites of academic publishers and scientific journals, screened on 19-...

Full description

Bibliographic Details
Main Authors: Ganjavi, C, Eppler, MB, Pekcan, A, Biedermann, B, Abreu, A, Collins, GS, Gill, IS, Cacciamani, GE
Format: Journal article
Language:English
Published: British Medical Journal Publishing Group 2024
_version_ 1824459081205678080
author Ganjavi, C
Eppler, MB
Pekcan, A
Biedermann, B
Abreu, A
Collins, GS
Gill, IS
Cacciamani, GE
author_facet Ganjavi, C
Eppler, MB
Pekcan, A
Biedermann, B
Abreu, A
Collins, GS
Gill, IS
Cacciamani, GE
author_sort Ganjavi, C
collection OXFORD
description Objectives: To determine the extent and content of academic publishers’ and scientific journals’ guidance for authors on the use of generative artificial intelligence (GAI). Design: Cross sectional, bibliometric study. Setting: Websites of academic publishers and scientific journals, screened on 19-20 May 2023, with the search updated on 8-9 October 2023. Participants: Top 100 largest academic publishers and top 100 highly ranked scientific journals, regardless of subject, language, or country of origin. Publishers were identified by the total number of journals in their portfolio, and journals were identified through the Scimago journal rank using the Hirsch index (H index) as an indicator of journal productivity and impact. Main outcome measures: The primary outcomes were the content of GAI guidelines listed on the websites of the top 100 academic publishers and scientific journals, and the consistency of guidance between the publishers and their affiliated journals. Results: Among the top 100 largest publishers, 24% provided guidance on the use of GAI, of which 15 (63%) were among the top 25 publishers. Among the top 100 highly ranked journals, 87% provided guidance on GAI. Of the publishers and journals with guidelines, the inclusion of GAI as an author was prohibited in 96% and 98%, respectively. Only one journal (1%) explicitly prohibited the use of GAI in the generation of a manuscript, and two (8%) publishers and 19 (22%) journals indicated that their guidelines exclusively applied to the writing process. When disclosing the use of GAI, 75% of publishers and 43% of journals included specific disclosure criteria. Where to disclose the use of GAI varied, including in the methods or acknowledgments, in the cover letter, or in a new section. Variability was also found in how to access GAI guidelines shared between journals and publishers. GAI guidelines in 12 journals directly conflicted with those developed by the publishers. The guidelines developed by top medical journals were broadly similar to those of academic journals. Conclusions: Guidelines by some top publishers and journals on the use of GAI by authors are lacking. Among those that provided guidelines, the allowable uses of GAI and how it should be disclosed varied substantially, with this heterogeneity persisting in some instances among affiliated publishers and journals. Lack of standardization places a burden on authors and could limit the effectiveness of the regulations. As GAI continues to grow in popularity, standardized guidelines to protect the integrity of scientific output are needed.
first_indexed 2025-02-19T04:36:07Z
format Journal article
id oxford-uuid:4d66fc50-0e91-43d9-9ce3-8a0be514dd08
institution University of Oxford
language English
last_indexed 2025-02-19T04:36:07Z
publishDate 2024
publisher British Medical Journal Publishing Group
record_format dspace
spelling oxford-uuid:4d66fc50-0e91-43d9-9ce3-8a0be514dd082025-02-02T20:04:51ZPublishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysisJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:4d66fc50-0e91-43d9-9ce3-8a0be514dd08EnglishJisc Publications RouterBritish Medical Journal Publishing Group2024Ganjavi, CEppler, MBPekcan, ABiedermann, BAbreu, ACollins, GSGill, ISCacciamani, GEObjectives: To determine the extent and content of academic publishers’ and scientific journals’ guidance for authors on the use of generative artificial intelligence (GAI). Design: Cross sectional, bibliometric study. Setting: Websites of academic publishers and scientific journals, screened on 19-20 May 2023, with the search updated on 8-9 October 2023. Participants: Top 100 largest academic publishers and top 100 highly ranked scientific journals, regardless of subject, language, or country of origin. Publishers were identified by the total number of journals in their portfolio, and journals were identified through the Scimago journal rank using the Hirsch index (H index) as an indicator of journal productivity and impact. Main outcome measures: The primary outcomes were the content of GAI guidelines listed on the websites of the top 100 academic publishers and scientific journals, and the consistency of guidance between the publishers and their affiliated journals. Results: Among the top 100 largest publishers, 24% provided guidance on the use of GAI, of which 15 (63%) were among the top 25 publishers. Among the top 100 highly ranked journals, 87% provided guidance on GAI. Of the publishers and journals with guidelines, the inclusion of GAI as an author was prohibited in 96% and 98%, respectively. Only one journal (1%) explicitly prohibited the use of GAI in the generation of a manuscript, and two (8%) publishers and 19 (22%) journals indicated that their guidelines exclusively applied to the writing process. When disclosing the use of GAI, 75% of publishers and 43% of journals included specific disclosure criteria. Where to disclose the use of GAI varied, including in the methods or acknowledgments, in the cover letter, or in a new section. Variability was also found in how to access GAI guidelines shared between journals and publishers. GAI guidelines in 12 journals directly conflicted with those developed by the publishers. The guidelines developed by top medical journals were broadly similar to those of academic journals. Conclusions: Guidelines by some top publishers and journals on the use of GAI by authors are lacking. Among those that provided guidelines, the allowable uses of GAI and how it should be disclosed varied substantially, with this heterogeneity persisting in some instances among affiliated publishers and journals. Lack of standardization places a burden on authors and could limit the effectiveness of the regulations. As GAI continues to grow in popularity, standardized guidelines to protect the integrity of scientific output are needed.
spellingShingle Ganjavi, C
Eppler, MB
Pekcan, A
Biedermann, B
Abreu, A
Collins, GS
Gill, IS
Cacciamani, GE
Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis
title Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis
title_full Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis
title_fullStr Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis
title_full_unstemmed Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis
title_short Publishers’ and journals’ instructions to authors on use of generative artificial intelligence in academic and scientific publishing: bibliometric analysis
title_sort publishers and journals instructions to authors on use of generative artificial intelligence in academic and scientific publishing bibliometric analysis
work_keys_str_mv AT ganjavic publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis
AT epplermb publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis
AT pekcana publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis
AT biedermannb publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis
AT abreua publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis
AT collinsgs publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis
AT gillis publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis
AT cacciamanige publishersandjournalsinstructionstoauthorsonuseofgenerativeartificialintelligenceinacademicandscientificpublishingbibliometricanalysis