Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?

Abstract Publications are commonly used to evaluate the productivity and impact of research programs. Traditional metrics examine publication impact through slowly accumulating academic citations. “Altmetrics” are a new way to describe early publication influence in nonacademic media/community spher...

Full description

Bibliographic Details
Main Authors: Nicole M. Llewellyn, Eric J. Nehl
Format: Article
Language:English
Published: Wiley 2022-06-01
Series:Clinical and Translational Science
Online Access:https://doi.org/10.1111/cts.13251
_version_ 1817968158372265984
author Nicole M. Llewellyn
Eric J. Nehl
author_facet Nicole M. Llewellyn
Eric J. Nehl
author_sort Nicole M. Llewellyn
collection DOAJ
description Abstract Publications are commonly used to evaluate the productivity and impact of research programs. Traditional metrics examine publication impact through slowly accumulating academic citations. “Altmetrics” are a new way to describe early publication influence in nonacademic media/community spheres (news, tweets, and blogs). Articles with significant altmetric attention make a big splash of immediate impact, whereas papers with high rates of academic citation reflect ripple effects of influence over time. Past research has found weak associations between altmetrics and academic citations. However, no previous research has focused on clinical/translational research, which aims to translate scientific discoveries to public use. Further, no previous research has assessed the relationship between altmetrics and modern citation impact factors like the National Institutes of Health (NIH)’s Relative Citation Ratio (RCR). It is also unclear whether publication in journals with higher journal impact factors (JIFs) may drive both public attention and academic impact. We investigated whether early altmetric indicators of splash predict citation ripples, beyond the effect of the JIF. For a portfolio of 2188 publications supported by the NIH’s Georgia Clinical and Translational Science Alliance from 2007–2020, we collected 2020 Altmetric Attention Scores (AAS), 2020 JIFs, and 2021 RCRs. All three were significantly correlated with one another. Regression analyses revealed that AAS significantly predicts later RCR, controlling for JIF and publication year. Findings indicate that in clinical/translational science, articles that make a big splash of altmetric attention have ripple effects through increased citation influence, which is not entirely due to publication in higher impact journals. Altmetric attention may be a useful early indicator of eventual influence and potential for translational advancement.
first_indexed 2024-04-13T20:04:25Z
format Article
id doaj.art-bb186fd9ca304a89ae8b51821f73a8c5
institution Directory Open Access Journal
issn 1752-8054
1752-8062
language English
last_indexed 2024-04-13T20:04:25Z
publishDate 2022-06-01
publisher Wiley
record_format Article
series Clinical and Translational Science
spelling doaj.art-bb186fd9ca304a89ae8b51821f73a8c52022-12-22T02:32:05ZengWileyClinical and Translational Science1752-80541752-80622022-06-011561387139210.1111/cts.13251Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?Nicole M. Llewellyn0Eric J. Nehl1Emory University School of Medicine Georgia Clinical and Translational Science Alliance Atlanta Georgia USAEmory University Rollins School of Public Health Atlanta Georgia USAAbstract Publications are commonly used to evaluate the productivity and impact of research programs. Traditional metrics examine publication impact through slowly accumulating academic citations. “Altmetrics” are a new way to describe early publication influence in nonacademic media/community spheres (news, tweets, and blogs). Articles with significant altmetric attention make a big splash of immediate impact, whereas papers with high rates of academic citation reflect ripple effects of influence over time. Past research has found weak associations between altmetrics and academic citations. However, no previous research has focused on clinical/translational research, which aims to translate scientific discoveries to public use. Further, no previous research has assessed the relationship between altmetrics and modern citation impact factors like the National Institutes of Health (NIH)’s Relative Citation Ratio (RCR). It is also unclear whether publication in journals with higher journal impact factors (JIFs) may drive both public attention and academic impact. We investigated whether early altmetric indicators of splash predict citation ripples, beyond the effect of the JIF. For a portfolio of 2188 publications supported by the NIH’s Georgia Clinical and Translational Science Alliance from 2007–2020, we collected 2020 Altmetric Attention Scores (AAS), 2020 JIFs, and 2021 RCRs. All three were significantly correlated with one another. Regression analyses revealed that AAS significantly predicts later RCR, controlling for JIF and publication year. Findings indicate that in clinical/translational science, articles that make a big splash of altmetric attention have ripple effects through increased citation influence, which is not entirely due to publication in higher impact journals. Altmetric attention may be a useful early indicator of eventual influence and potential for translational advancement.https://doi.org/10.1111/cts.13251
spellingShingle Nicole M. Llewellyn
Eric J. Nehl
Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?
Clinical and Translational Science
title Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?
title_full Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?
title_fullStr Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?
title_full_unstemmed Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?
title_short Predicting citation impact from altmetric attention in clinical and translational research: Do big splashes lead to ripple effects?
title_sort predicting citation impact from altmetric attention in clinical and translational research do big splashes lead to ripple effects
url https://doi.org/10.1111/cts.13251
work_keys_str_mv AT nicolemllewellyn predictingcitationimpactfromaltmetricattentioninclinicalandtranslationalresearchdobigsplashesleadtorippleeffects
AT ericjnehl predictingcitationimpactfromaltmetricattentioninclinicalandtranslationalresearchdobigsplashesleadtorippleeffects