Development and preliminary validation of an open access, open data and open outreach indicator
We present the development and preliminary validation of a new person-centered indicator that we propose is named “OADO” after its target concepts: Open Access (OA), Open Data (OD) and Open Outreach (OO). The indicator is comprised of two factors: the research factor indicating the degree of OA arti...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-09-01
|
| Series: | Frontiers in Research Metrics and Analytics |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frma.2023.1218213/full |
| _version_ | 1827822689077690368 |
|---|---|
| author | Evgenios Vlachos Evgenios Vlachos Regine Ejstrup Thea Marie Drachen Bertil Fabricius Dorch Bertil Fabricius Dorch |
| author_facet | Evgenios Vlachos Evgenios Vlachos Regine Ejstrup Thea Marie Drachen Bertil Fabricius Dorch Bertil Fabricius Dorch |
| author_sort | Evgenios Vlachos |
| collection | DOAJ |
| description | We present the development and preliminary validation of a new person-centered indicator that we propose is named “OADO” after its target concepts: Open Access (OA), Open Data (OD) and Open Outreach (OO). The indicator is comprised of two factors: the research factor indicating the degree of OA articles and OD in research; and the communication factor indicating the degree of OO in communication activities in which a researcher has participated. We stipulate that the weighted version of this new indicator, the Weighted-OADO, can be used to assess the openness of researchers in relation to their peers from their own discipline, department, or even group/center. The OADO is developed and customized to the needs of Elsevier's Research Information Management System (RIMS) environment, Pure. This offers the advantage of more accurate interpretations and recommendations for action, as well as the possibility to be implemented (and further validated) by multiple institutions, allowing disciplinary comparisons of the open practices across multiple institutes. Therefore, the OADO provides recommendations for action, and enables institutes to make informed decisions based on the indicator's outcome. To test the validity of the OADO, we retrieved the Pure publication records from two departments for each of the five faculties of the University of Southern Denmark and calculated the OADO of 995 researchers in total. We checked for definition validity, actionability, transferability, possibility of unexpected discontinuities of the indicator, factor independence, normality of the indicator's distributions across the departments, and indicator reliability. Our findings reveal that the OADO is a reliable indicator for departments with normally distributed values with regards to their Weighted-OADO. Unfortunately, only two departments displayed normal distributions, one from the health sciences and one from engineering. For departments where the normality assumption is not satisfied, the OADO can still be useful as it can indicate the need for making a greater effort toward openness, and/or act as an incentive for detailed registration of research outputs and datasets. |
| first_indexed | 2024-03-12T02:01:14Z |
| format | Article |
| id | doaj.art-640c73e93aaa47b18554febc0af7d1dd |
| institution | Directory Open Access Journal |
| issn | 2504-0537 |
| language | English |
| last_indexed | 2024-03-12T02:01:14Z |
| publishDate | 2023-09-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Research Metrics and Analytics |
| spelling | doaj.art-640c73e93aaa47b18554febc0af7d1dd2023-09-07T13:44:19ZengFrontiers Media S.A.Frontiers in Research Metrics and Analytics2504-05372023-09-01810.3389/frma.2023.12182131218213Development and preliminary validation of an open access, open data and open outreach indicatorEvgenios Vlachos0Evgenios Vlachos1Regine Ejstrup2Thea Marie Drachen3Bertil Fabricius Dorch4Bertil Fabricius Dorch5University Library of Southern Denmark, University of Southern Denmark, Odense, DenmarkThe Maersk Mc-Kinney Moller Institute, University of Southern Denmark, Odense, DenmarkUniversity Library of Southern Denmark, University of Southern Denmark, Odense, DenmarkUniversity Library of Southern Denmark, University of Southern Denmark, Odense, DenmarkUniversity Library of Southern Denmark, University of Southern Denmark, Odense, DenmarkDepartment of Physics, Chemistry and Pharmacy, University of Southern Denmark, Odense, DenmarkWe present the development and preliminary validation of a new person-centered indicator that we propose is named “OADO” after its target concepts: Open Access (OA), Open Data (OD) and Open Outreach (OO). The indicator is comprised of two factors: the research factor indicating the degree of OA articles and OD in research; and the communication factor indicating the degree of OO in communication activities in which a researcher has participated. We stipulate that the weighted version of this new indicator, the Weighted-OADO, can be used to assess the openness of researchers in relation to their peers from their own discipline, department, or even group/center. The OADO is developed and customized to the needs of Elsevier's Research Information Management System (RIMS) environment, Pure. This offers the advantage of more accurate interpretations and recommendations for action, as well as the possibility to be implemented (and further validated) by multiple institutions, allowing disciplinary comparisons of the open practices across multiple institutes. Therefore, the OADO provides recommendations for action, and enables institutes to make informed decisions based on the indicator's outcome. To test the validity of the OADO, we retrieved the Pure publication records from two departments for each of the five faculties of the University of Southern Denmark and calculated the OADO of 995 researchers in total. We checked for definition validity, actionability, transferability, possibility of unexpected discontinuities of the indicator, factor independence, normality of the indicator's distributions across the departments, and indicator reliability. Our findings reveal that the OADO is a reliable indicator for departments with normally distributed values with regards to their Weighted-OADO. Unfortunately, only two departments displayed normal distributions, one from the health sciences and one from engineering. For departments where the normality assumption is not satisfied, the OADO can still be useful as it can indicate the need for making a greater effort toward openness, and/or act as an incentive for detailed registration of research outputs and datasets.https://www.frontiersin.org/articles/10.3389/frma.2023.1218213/fullopen scienceopen accessopen dataoutreachmetricsresponsible use of indicators |
| spellingShingle | Evgenios Vlachos Evgenios Vlachos Regine Ejstrup Thea Marie Drachen Bertil Fabricius Dorch Bertil Fabricius Dorch Development and preliminary validation of an open access, open data and open outreach indicator Frontiers in Research Metrics and Analytics open science open access open data outreach metrics responsible use of indicators |
| title | Development and preliminary validation of an open access, open data and open outreach indicator |
| title_full | Development and preliminary validation of an open access, open data and open outreach indicator |
| title_fullStr | Development and preliminary validation of an open access, open data and open outreach indicator |
| title_full_unstemmed | Development and preliminary validation of an open access, open data and open outreach indicator |
| title_short | Development and preliminary validation of an open access, open data and open outreach indicator |
| title_sort | development and preliminary validation of an open access open data and open outreach indicator |
| topic | open science open access open data outreach metrics responsible use of indicators |
| url | https://www.frontiersin.org/articles/10.3389/frma.2023.1218213/full |
| work_keys_str_mv | AT evgeniosvlachos developmentandpreliminaryvalidationofanopenaccessopendataandopenoutreachindicator AT evgeniosvlachos developmentandpreliminaryvalidationofanopenaccessopendataandopenoutreachindicator AT regineejstrup developmentandpreliminaryvalidationofanopenaccessopendataandopenoutreachindicator AT theamariedrachen developmentandpreliminaryvalidationofanopenaccessopendataandopenoutreachindicator AT bertilfabriciusdorch developmentandpreliminaryvalidationofanopenaccessopendataandopenoutreachindicator AT bertilfabriciusdorch developmentandpreliminaryvalidationofanopenaccessopendataandopenoutreachindicator |