Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers
Performance evaluation is a broad discipline within computer science, combining deep technical work in experimentation, simulation, and modeling. The field’s subjects encompass all aspects of computer systems, including computer architecture, networking, energy efficiency, and machine learning. This...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-12-01
|
| Series: | Publications |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2304-6775/10/4/47 |
| _version_ | 1797455493290000384 |
|---|---|
| author | Eitan Frachtenberg |
| author_facet | Eitan Frachtenberg |
| author_sort | Eitan Frachtenberg |
| collection | DOAJ |
| description | Performance evaluation is a broad discipline within computer science, combining deep technical work in experimentation, simulation, and modeling. The field’s subjects encompass all aspects of computer systems, including computer architecture, networking, energy efficiency, and machine learning. This wide methodological and topical focus can make it difficult to discern what attracts the community’s attention and how this attention evolves over time. As a first attempt to quantify and qualify this attention, using the proxy metric of paper citations, this study looks at the premier conference in the field, SIGMETRICS. We analyze citation frequencies at monthly intervals over a five-year period and examine possible associations with myriad other factors, such as time since publication, comparable conferences, peer review, self-citations, author demographics, and textual properties of the papers. We found that in several ways, SIGMETRICS is distinctive not only in its scope, but also in its citation phenomena: papers generally exhibit a strongly linear rate of citation growth over time, few if any uncited papers, a large gamut of topics of interest, and a possible disconnect between peer-review outcomes and eventual citations. The two most-cited papers in the dataset also exhibit larger author teams, higher than typical self-citations, and distinctive citation growth curves. These two papers, sharing some coauthors and a research focus, could either signal the area where SIGMETRICS had the most research impact, or they could represent outliers; their omission from the analysis reduces some of the otherwise distinctive observed metrics to nonsignificant levels. |
| first_indexed | 2024-03-09T15:55:10Z |
| format | Article |
| id | doaj.art-1d32b7d3fb094f93accf8ca549945600 |
| institution | Directory Open Access Journal |
| issn | 2304-6775 |
| language | English |
| last_indexed | 2024-03-09T15:55:10Z |
| publishDate | 2022-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Publications |
| spelling | doaj.art-1d32b7d3fb094f93accf8ca5499456002023-11-24T17:42:32ZengMDPI AGPublications2304-67752022-12-011044710.3390/publications10040047Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS PapersEitan Frachtenberg0Department of Computer Science, Reed College, 3203 Woodstock Blvd, Portland, OR 97202, USAPerformance evaluation is a broad discipline within computer science, combining deep technical work in experimentation, simulation, and modeling. The field’s subjects encompass all aspects of computer systems, including computer architecture, networking, energy efficiency, and machine learning. This wide methodological and topical focus can make it difficult to discern what attracts the community’s attention and how this attention evolves over time. As a first attempt to quantify and qualify this attention, using the proxy metric of paper citations, this study looks at the premier conference in the field, SIGMETRICS. We analyze citation frequencies at monthly intervals over a five-year period and examine possible associations with myriad other factors, such as time since publication, comparable conferences, peer review, self-citations, author demographics, and textual properties of the papers. We found that in several ways, SIGMETRICS is distinctive not only in its scope, but also in its citation phenomena: papers generally exhibit a strongly linear rate of citation growth over time, few if any uncited papers, a large gamut of topics of interest, and a possible disconnect between peer-review outcomes and eventual citations. The two most-cited papers in the dataset also exhibit larger author teams, higher than typical self-citations, and distinctive citation growth curves. These two papers, sharing some coauthors and a research focus, could either signal the area where SIGMETRICS had the most research impact, or they could represent outliers; their omission from the analysis reduces some of the otherwise distinctive observed metrics to nonsignificant levels.https://www.mdpi.com/2304-6775/10/4/47SIGMETRICSbibliometricsfactors in citation |
| spellingShingle | Eitan Frachtenberg Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers Publications SIGMETRICS bibliometrics factors in citation |
| title | Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers |
| title_full | Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers |
| title_fullStr | Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers |
| title_full_unstemmed | Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers |
| title_short | Multifactor Citation Analysis over Five Years: A Case Study of SIGMETRICS Papers |
| title_sort | multifactor citation analysis over five years a case study of sigmetrics papers |
| topic | SIGMETRICS bibliometrics factors in citation |
| url | https://www.mdpi.com/2304-6775/10/4/47 |
| work_keys_str_mv | AT eitanfrachtenberg multifactorcitationanalysisoverfiveyearsacasestudyofsigmetricspapers |