In the next few years, profound changes will come in how academic achievements will be evaluated, both in hiring and in funding decisions. Multiple initiatives (e.g., DORA, CoARA, LERU) strive to abandon invalid indicators (journal impact factors, h-index) and to develop alternative indicators of research assessment that better reflect quality (instead of quantity) in research assessment. But how can we practically implement and evaluate a reformed research assessment? What will be the consequences for researchers and institutions?
A task force established by the German Psychological Society recently published a proposal on how responsible research assessment could be done in the field of psychology. We present four principles of responsible research assessment in hiring and promotion and suggest a two-phase assessment procedure that combines the objectivity and efficiency of indicators with a qualitative, discursive assessment of shortlisted candidates. The main aspects of our proposal are (a) to broaden the range of relevant research contributions to include published data sets and research software, along with research papers, and (b) to place greater emphasis on quality and rigor in research evaluation, including open science.
Presenter
Prof. Dr. Felix Schönbrodt, Ludwig-Maximilians-Universität München, Anne Gärtner, and Daniel Leising
Social media:
Mastodon: @nicebread@scicomm.xyz