Open Science Assessment Framework (OSAF)

Introducing Open Science practices in Responsible Research Assessment is not a trivial task and we cannot simply transpose traditional assessment approaches from current bibliometric, a one-size-fits-all approach, in a straightforward manner to assess research in an emerging open science ecosystem. Even though the primary aim of GraspOS is to develop and operationalize an infrastructure for metrics (data-tools-services), one can expect that this will have an uptake and impact only if it is able to convince on its merits. This means that the infrastructure should be carefully crafted to address specific needs, bring trust, provide practical tools, and be easily embedded in monitoring processes (e.g., via EOSC).

Managing a complex change requires a good understanding of the different options provided, and especially the use of the underlying infrastructure. Starting from objectives and policy commitments, organisations are in pursuit on which are the most fitting indicators (what to measure) and on what types of metrics to use (how to measure, compare, interact in a trusted way). GraspOS will systematize the process of collecting information around OS-enabled assessment protocols, which describe the processes from conception to solution.

A co-developed Open Science Assessment Framework (OSAF) will document and provide options on how indicators and tools used in a particular evaluation setting align with the specific characteristics of the assessment context, such as the disciplinary and institutional context and the level at which the assessment takes place (e.g., individual researchers, research groups, research institutions, national level). It will be a key resource for advising implementation and next steps.

The following diagram gives a high-level view of how OSAF is in the core of GraspOS binding the community with the infrastructure.