We are happy to announce that a new study “Assessing the reproducibility of research results in EU Framework Programmes for Research” has been published by the European Commission. The study team who prepared this report would also like to invite you to a webinar where you will get the opportunity to learn more about the study and share your views and opinions.
Mixed-methods research design that included the assessment of Horizon 2020 projects
The study was commissioned by the Directorate-General for Research and Innovation (DG RTD) of the European Commission, and it was carried out by PPMI in collaboration with two project partners: Know-Centre and Athena RC. The objective of the study was to assist the European Commission in understanding, testing, and monitoring the progress of reproducibility over time and across the Framework Programmes.
The study primarily focused on the state of reproducibility during the implementation of Horizon 2020 and relied on a mixed-methods research design. It combined qualitative textual analysis of 50 Horizon 2020 projects and quantitative assessment of 300 Horizon 2020 projects (including assessments of FAIR-ness, reusability, and citation semantic analysis), as well as a large-scale survey programme of researchers, journal editors, and research funders. However, the study also goes beyond H2020 and explores various aspects related to reproducibility and open science in science in general.
Reproducibility and open science is valued by stakeholders but barriers persist
The study results indicate that reproducibility of research and open science are important principles to researchers and other stakeholders. The scope of implementation of reproducibility-related practices is mixed depending on the reproducibility-related aspect under assessment. The study identified the prevalence of cultural barriers for reproducibility in the scientific field (e.g. pressure to publish, lack of recognition of reproducibility-related research practices) and the perception that reproducibility is costly in terms of time and resources. Based on these and many other interesting findings, the report provides a comprehensive set of recommendations for research funders to overcome the existing barriers and increase the reproducibility of EU-funded research and innovation.
You can find the study report available for download here.
Webinar to present the results
We would also appreciate your participation in the webinar, during which we will discuss key findings, representatives of the Commission will share their take on the study and the policy plans toward reproducibility and open science, and we will hold a Q&A session where we would like to hear your views and ideas. The webinar will be concluded by a closing presentation held by keynote speaker Tim Errington, the director of research at the Center for Open Science. You can access the preliminary agenda through the registration link.
The webinar takes place on 28 June 2022, from 16:00 to 17:30 CET. The Webinar will take place in English.
If you are interested in the study and would like to participate in this webinar, please follow this link and register before 27 June 2022.