Skip to main content

Wellcome peer review report

Copyright Wellcome Trust CC BY 2.0


Copyright Research Information Network
A Wellcome Trust commissioned report centred around the issue of peer review was published last month. The report, conducted by the Research Information Network, sets out a detailed analysis of peer review, the critiques, and the new alternative systems for peer review that have appeared in recent years.

The report defines traditional peer review as 'the process of subjecting an author’s scholarly manuscript to the scrutiny of others who are experts in the same field’ (p.6) These experts must assess whether the research is of sufficient quality to be included in the journal. Many journals also require reviewers to assess the originality and significance of research, however it is worth noting that some open access mega-journals such as PLOS ONE and Collabra do not require this.

The report details many of the criticisms commonly made of peer review. One criticism is that peer review is not effective at weeding out unsound research. The report makes mention of the fact that retraction rates have increased in recent years, although the volume of retractions is a very small proportion of the 2 million papers published each year globally. Another criticism mentioned in the report is the burden faced by reviewers, the vast majority of whom are unpaid. Research suggests that around 3 million papers are submitted for review each year, and many are submitted and reviewed more than once. This represents a significant burden on reviewers, half of whom spend more than 6 hours on each review (see our recent blog post on the new journal Collabra that compensates reviewers by paying them a proportion of APC income). Other criticisms include potential for bias, expense, delays, and the potential for subversive behaviour.

Given the criticisms and the potential new avenues afforded by new digital technologies there have been many experiments with alternative forms of peer review. To take one example, open review sees both author's and reviewer's names disclosed from the outset (for example BMJ and PeerJ) and is designed to encourage constructive comments and avoid overly harsh reviews. Journals such as Frontiers (see previous blog post here) have expanded on this idea and introduced an interactive communication element to their open review process.

After investigating the various forms of peer-review the report concludes that peer review "remains a bedrock of the scholarly communications system", but reflects that there is likely to be increasing pressure on traditional peer review systems as the rate and volume of scholarly communication increases. It is this continuing pressure that will ensure experimentation with new forms of peer review will continue with cooperation between research and publishing communities:
'[W]e detect a sense in which while publishers will continue to explore new approaches in the ways we have described, they would welcome more guidance from key sections of the research community on the kinds of peer review services they want from publishers, and on the purposes that they should seek to fulfil. Unless the purposes are defined with greater clarity than they are at present, at least some of the current experimentation may prove to be of little point.' Scholarly Communication and Peer Review: The Current Landscape and Future Trends, p.30. CC BY

The full report, Scholarly Communication and Peer Review: The Current Landscape and Future Trends, can be found here.

Comments

Popular posts from this blog

Untangling Academic Publishing: Scottish launch for OA Week

St Andrews University Library is delighted to host the Scottish Launch of Untangling Academic Publishing during Open Access Week - the event is open to all, discussion encouraged!

>Please contact libraryoffice@st-andrews.ac.uk if you wish to attend.

Untangling Academic Publishing: Launch and Discussion about the past and future of academic publishingA University Library event for Open Access Week

Tuesday 24 October, 16.00-18.30 - Arts Lecture Theatre (No.31 on the map)

Presentation: Professor Aileen Fyfe, School of History, lead author of the briefing paper ‘Untangling Academic Publishing’, will explain some of the biggest changes in academic publishing over the last 60 years.

Panel Discussion: the talk will be followed by a discussion of possible futures.
Professor Fyfe will be in conversation with Professor Stephen Curry,  Imperial College London and Professor Martin Kretschmer, University of Glasgow.

Presentation and panel discussion will be followed by a wine reception.



Untangling…

Your Open Access - statistics and usage

It's Open Access Week again, and this year the theme is 'Open in order to...' This year's theme is designed to shift discussion away from wider issues of 'openness', and instead direct attention to the tangible benefits of open access. This week we will be publishing a series of posts aimed at  highlighting some of these benefits. In this post we will look at some of the statistics we gather about the open access content in our Repository, and specifically the statistics that we've chosen to highlight in our new Infographic.
Given the theme of this year's Open Access Week, the subject of this post could be appropriately described as 'Open in order to boost downloads' For years we have been collecting usage statistics about the content held in our repository. Up until now this data has been collected and, for the most part, discussed internally; but not any more. Now we want to show the academic community here in St Andrews, whose work populates …

Knowledge Exchange on the costs of Open Access

The cost of Open Access isn't a late-breaking field. In 2014 a cost of £9.2m for UK research organisations to achieve RCUK Open Access compliance was quoted [1]. This is in addition to the millions paid to publishers for article processing charges.  Because the market in scholarly publications is constantly adapting and costs for Open Access and library journal subscriptions are inexorably rising, it's incumbent on institutions to monitor not just the cost of the product, but the cost of managing it.  Open Access and open data have been identified as strategic for Librarians and university senior management [2].


The Knowledge Exchange partnership works at an international level to develop the infrastructure of open scholarship and promote common standards.  It regularly publishes reports on its activities. Its consensus report on monitoring Open Access publications and cost data published April last year makes recommendations based on the work and feedback from stakeholders at…