Centre for Science and Technology Studies Centre for Science and Technology Studies 2333AL Leiden Zuid Holland 31715273909

Responsible Metrics for Research Evaluation

In recent years, there have been lots of discussions about responsible use of metrics in research management and research evaluation. The San Francisco Declaration on Research Assessment (DORA) has received widespread support. Likewise, the ten principles for responsible use of metrics put forward in the Leiden Manifesto have been highly visible in discussions about the use of quantitative indicators in research evaluation. The course Responsible Metrics for Research Evaluation provides an overview of the key topics discussed in the responsible metrics debate. In addition to the practical experience of the lecturers, the course draws extensively on state-of-the-art insights from the literature in the fields of scientometrics and science and technology studies.


The aim of the course is to provide participants with a thorough understanding of the key issues related to responsible uses of metrics in research management and research evaluation. These issues will be addressed from a variety of perspectives. In addition to theoretical, conceptual, and methodological approaches, a variety of case studies will be presented to illustrate issues related to responsible metrics.


The lecturers are Sarah de Rijcke, Ludo Waltman, Ismael Rafols, Rinze Benedictus, and Stephen Curry. De Rijcke, Waltman, and Rafols are co-authors of the Leiden Manifesto. Benedictus has been involved in the development and implementation of responsible research evaluation approaches at the University Medical Center Utrecht. Curry is one of the initiators of DORA and chair of the DORA steering committee.


The course serves a broad audience that includes anyone with a professional interest in responsible uses of metrics in research management and research evaluation. The maximum number of participants in the course is 20.


The course will take place in the Willem Einthoven Building of Leiden University in the Netherlands.


The course takes three days. The next edition of the course will take place on March 30- April 1, 2020.


The course is structured around the ten principles of the Leiden Manifesto (LM):

  • Day 1 will introduce the LM and DORA. It will then cover issues related to research evaluation and research governance, the use of indicators, systemic effects, and locally relevant research (LM principles 1, 2, 3, and 9). At the end of the day, there will be a course dinner for all lecturers and participants.
  • Day 2 will cover issues related to openness and transparency, disciplinary differences, and contextualization and participation (LM principles 4, 5, and 6).
  • Day 3 will cover issues related to uncertainty and ambiguity in quantitative indicators. It will also cover portfolio approaches to assessment of individual researchers and other new evaluation approaches (LM principles 7, 8, and 10).

Course fee

The course fee is € 1550. This covers the cost of tuition, course material, coffee breaks, lunches, and a course dinner. Participants that also register for the course Visualizing Science Using VOSviewer (April 2 and 3) will get a 10% discount on the fee of both courses.


To register for the course, please use this booking form. Registration is on a first come, first serve basis.


Please contact Karin den Dulk if you need further information about the course.

Build on Applepie CMS by Waltman Development