New move to act for research assessment reform


Bethesda, MD – Feb. 7, 2018 – Stephen Curry, Professor of Structural Biology at Imperial College in London, is calling for research assessment reform to become more than just words. As chair of a new steering committee behind the San Francisco Declaration on Research Assessment (DORA), Professor Curry’s call to action is bolstered by investments from nine organizations in the U.S. and Europe combined with signatures on the Declaration for each of the U.K.’s seven Research Councils. The news is announced in a World View column published in the February 8th issue of Nature and available online today.

Formally introduced in May 17, 2013, DORA calls on funding agencies, institutions, publishers, metrics suppliers, and researchers to take a modern approach to the evaluation of research and researchers. The Declaration makes recommendations for each group, insisting that the whole academic enterprise should no longer “use journal-based metrics, such as Journal Impact Factors, as a surrogate measure of the quality of individual research articles, to assess an individual scientist’s contributions, or in hiring, promotion, or funding decisions.” DORA has been signed by nearly 12,000 individuals and hundreds of organizations.

However, Curry – an outspoken advocate for a better way to evaluate scientists – says DORA has yet to succeed in all its aims:

“… processes for JIF-free assessment have yet to gain credibility even at some institutions that signed on to DORA. Stories of university research managers demanding high JIFs percolate from tenured professors to graduate student. Job and grant applicants feel that they can’t compete unless they publish in prominent journals. Institutions and individual scientists are are fearful of shrugging of the familiar harness of entrenched reward systems.

“So DORA’s job now is to accelerate the change it called for.”

His hope is that support from funders, publishers and societies will give DORA the momentum it needs to be transformed from a rallying point into “a tool for evaluating researchers fairly.” The American Society for Cell Biology, Cancer Research UK, Company of Biologists, eLife, European Molecular Biology Organization, Faculty of 1000, Hindawi, Public Library of Science, and Wellcome have committed to support the initiative for at least the next two years.

Backing from the UK Research Councils is another significant cue that the commitment to bringing DORA principles to life is growing stronger. Public funders disbursing over three billion pounds in research each year (over $4.27b USD), the Research Councils are the most recent in a string of public and private funders to sign the declaration – now including the Bill and Melinda Gates Foundation, the Swiss National Science Foundation, and the Indian Department of Biotechnology. The Councils published a statement about this move on their website, http://www.rcuk.ac.uk.

On the future of DORA Curry writes, “We are committed to getting on with the job. Our goal is to discover and disseminate examples of good practice and also to boost the profile of assessment reform. We will do that at research conferences and online discussions; we will also establish regional nodes across the world run by volunteers who will work to identify and address local issues.” The group has also updated its website at https://sfdora.org.

“Declarations like DORA are important; credible alternatives to the status quo are more so. True success will mean more institutions in a broader swath of the world bragging about the quality of their research assessment procedures rather than the size of their JIFs.”

###

The full column, ‘DORA moves from shining rhetoric to gritty reality’, is published in the February 8 issue of Nature.

Read the full San Francisco Declaration on Research Assessment at https://sfdora.org