Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple Case

Previous research on indicators for measuring the success of Open Science tends to operate at a macro/global level and very rarely addresses the need to measure success at the level of a single project. However, this previous research has the merit of arguing for the definition of indicators that of...

Full description

Bibliographic Details
Main Authors: Stefano De Paoli, Emilie Blotière, Paula Forbes, Sona Arasteh-Roodsary
Format: Article
Language:English
Published: MDPI AG 2022-12-01
Series:Publications
Subjects:
Online Access:https://www.mdpi.com/2304-6775/10/4/49
_version_ 1797455545008914432
author Stefano De Paoli
Emilie Blotière
Paula Forbes
Sona Arasteh-Roodsary
author_facet Stefano De Paoli
Emilie Blotière
Paula Forbes
Sona Arasteh-Roodsary
author_sort Stefano De Paoli
collection DOAJ
description Previous research on indicators for measuring the success of Open Science tends to operate at a macro/global level and very rarely addresses the need to measure success at the level of a single project. However, this previous research has the merit of arguing for the definition of indicators that offer an alternative to more traditional bibliometric measures or indicators that focus on mere performance. This paper is the outcome of work conducted for a specific project that aims to build a discovery platform for social sciences and humanities, the platform GoTriple. GoTriple is designed taking inspiration from Open Science principles and has been built through a user-centered approach. The paper details the practice-led work conducted by the GoTriple team for assessing the meaning of the term success for the project and to identify indicators. To this end, this paper proposes the concept of compass indicators and presents how the project team arrived at the definition of this concept. The paper also highlights a distinction between compass indicators, which are modest measures, and key performance indicators, which tend to be tied up with measurable objectives. Compass indicators are defined as indicators that do not aim to achieve a specified numerical target of success but rather explain the journey of a project toward achieving certain desirable outcomes and offer insights to take action. Compass indicators defined for the project embrace areas such as diversity, inclusivity, collaboration, and the general use of the platform. In the final discussion, the paper offers reflections on the potential relevance of the notion of compass indicators and closes with a discussion of the next steps for this work.
first_indexed 2024-03-09T15:55:50Z
format Article
id doaj.art-c41c3ef5669d44718c0e3532bc143d80
institution Directory Open Access Journal
issn 2304-6775
language English
last_indexed 2024-03-09T15:55:50Z
publishDate 2022-12-01
publisher MDPI AG
record_format Article
series Publications
spelling doaj.art-c41c3ef5669d44718c0e3532bc143d802023-11-24T17:42:34ZengMDPI AGPublications2304-67752022-12-011044910.3390/publications10040049Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple CaseStefano De Paoli0Emilie Blotière1Paula Forbes2Sona Arasteh-Roodsary3Division of Sociology, Abertay University, Bell Street, Dundee DD11HG, UKCNRS National Center for Scientific Research, 8Cr de Humanités, 93300 Aubervilliers, FranceDivision of Sociology, Abertay University, Bell Street, Dundee DD11HG, UKMax Weber Stiftung, Rheinallee 6, 53173 Bonn, GermanyPrevious research on indicators for measuring the success of Open Science tends to operate at a macro/global level and very rarely addresses the need to measure success at the level of a single project. However, this previous research has the merit of arguing for the definition of indicators that offer an alternative to more traditional bibliometric measures or indicators that focus on mere performance. This paper is the outcome of work conducted for a specific project that aims to build a discovery platform for social sciences and humanities, the platform GoTriple. GoTriple is designed taking inspiration from Open Science principles and has been built through a user-centered approach. The paper details the practice-led work conducted by the GoTriple team for assessing the meaning of the term success for the project and to identify indicators. To this end, this paper proposes the concept of compass indicators and presents how the project team arrived at the definition of this concept. The paper also highlights a distinction between compass indicators, which are modest measures, and key performance indicators, which tend to be tied up with measurable objectives. Compass indicators are defined as indicators that do not aim to achieve a specified numerical target of success but rather explain the journey of a project toward achieving certain desirable outcomes and offer insights to take action. Compass indicators defined for the project embrace areas such as diversity, inclusivity, collaboration, and the general use of the platform. In the final discussion, the paper offers reflections on the potential relevance of the notion of compass indicators and closes with a discussion of the next steps for this work.https://www.mdpi.com/2304-6775/10/4/49indicatorsopen sciencediscoverydiversityusersocial sciences
spellingShingle Stefano De Paoli
Emilie Blotière
Paula Forbes
Sona Arasteh-Roodsary
Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple Case
Publications
indicators
open science
discovery
diversity
user
social sciences
title Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple Case
title_full Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple Case
title_fullStr Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple Case
title_full_unstemmed Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple Case
title_short Measuring and Promoting the Success of an Open Science Discovery Platform through “Compass Indicators”: The GoTriple Case
title_sort measuring and promoting the success of an open science discovery platform through compass indicators the gotriple case
topic indicators
open science
discovery
diversity
user
social sciences
url https://www.mdpi.com/2304-6775/10/4/49
work_keys_str_mv AT stefanodepaoli measuringandpromotingthesuccessofanopensciencediscoveryplatformthroughcompassindicatorsthegotriplecase
AT emilieblotiere measuringandpromotingthesuccessofanopensciencediscoveryplatformthroughcompassindicatorsthegotriplecase
AT paulaforbes measuringandpromotingthesuccessofanopensciencediscoveryplatformthroughcompassindicatorsthegotriplecase
AT sonaarastehroodsary measuringandpromotingthesuccessofanopensciencediscoveryplatformthroughcompassindicatorsthegotriplecase