Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data.
In this study, we address the question whether (and to what extent, respectively) altmetrics are related to the scientific quality of papers (as measured by peer assessments). Only a few studies have previously investigated the relationship between altmetrics and assessments by peers. In the first s...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2018-01-01
|
| Series: | PLoS ONE |
| Online Access: | http://europepmc.org/articles/PMC5965816?pdf=render |
| _version_ | 1818164080590979072 |
|---|---|
| author | Lutz Bornmann Robin Haunschild |
| author_facet | Lutz Bornmann Robin Haunschild |
| author_sort | Lutz Bornmann |
| collection | DOAJ |
| description | In this study, we address the question whether (and to what extent, respectively) altmetrics are related to the scientific quality of papers (as measured by peer assessments). Only a few studies have previously investigated the relationship between altmetrics and assessments by peers. In the first step, we analyse the underlying dimensions of measurement for traditional metrics (citation counts) and altmetrics-by using principal component analysis (PCA) and factor analysis (FA). In the second step, we test the relationship between the dimensions and quality of papers (as measured by the post-publication peer-review system of F1000Prime assessments)-using regression analysis. The results of the PCA and FA show that altmetrics operate along different dimensions, whereas Mendeley counts are related to citation counts, and tweets form a separate dimension. The results of the regression analysis indicate that citation-based metrics and readership counts are significantly more related to quality, than tweets. This result on the one hand questions the use of Twitter counts for research evaluation purposes and on the other hand indicates potential use of Mendeley reader counts. |
| first_indexed | 2024-12-11T16:59:46Z |
| format | Article |
| id | doaj.art-2fad1251d1904e71876a1af3d738887a |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-11T16:59:46Z |
| publishDate | 2018-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-2fad1251d1904e71876a1af3d738887a2022-12-22T00:57:52ZengPublic Library of Science (PLoS)PLoS ONE1932-62032018-01-01135e019713310.1371/journal.pone.0197133Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data.Lutz BornmannRobin HaunschildIn this study, we address the question whether (and to what extent, respectively) altmetrics are related to the scientific quality of papers (as measured by peer assessments). Only a few studies have previously investigated the relationship between altmetrics and assessments by peers. In the first step, we analyse the underlying dimensions of measurement for traditional metrics (citation counts) and altmetrics-by using principal component analysis (PCA) and factor analysis (FA). In the second step, we test the relationship between the dimensions and quality of papers (as measured by the post-publication peer-review system of F1000Prime assessments)-using regression analysis. The results of the PCA and FA show that altmetrics operate along different dimensions, whereas Mendeley counts are related to citation counts, and tweets form a separate dimension. The results of the regression analysis indicate that citation-based metrics and readership counts are significantly more related to quality, than tweets. This result on the one hand questions the use of Twitter counts for research evaluation purposes and on the other hand indicates potential use of Mendeley reader counts.http://europepmc.org/articles/PMC5965816?pdf=render |
| spellingShingle | Lutz Bornmann Robin Haunschild Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. PLoS ONE |
| title | Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. |
| title_full | Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. |
| title_fullStr | Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. |
| title_full_unstemmed | Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. |
| title_short | Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data. |
| title_sort | do altmetrics correlate with the quality of papers a large scale empirical study based on f1000prime data |
| url | http://europepmc.org/articles/PMC5965816?pdf=render |
| work_keys_str_mv | AT lutzbornmann doaltmetricscorrelatewiththequalityofpapersalargescaleempiricalstudybasedonf1000primedata AT robinhaunschild doaltmetricscorrelatewiththequalityofpapersalargescaleempiricalstudybasedonf1000primedata |