{"id":2393,"date":"2014-11-25T02:14:25","date_gmt":"2014-11-25T02:14:25","guid":{"rendered":"http:\/\/www.lifeandnews.com\/articles\/?p=2393"},"modified":"2016-08-18T17:23:23","modified_gmt":"2016-08-18T17:23:23","slug":"what-counts-as-an-academic-publication","status":"publish","type":"post","link":"https:\/\/www.lifeandnews.com\/articles\/what-counts-as-an-academic-publication\/","title":{"rendered":"What counts as an academic publication?"},"content":{"rendered":"

By Christopher Sampson<\/a>, University of Nottingham<\/em><\/p>\n

What is it that sets academic publications apart from articles on The Conversation? Peer review might be your first answer. While The Conversation is built around a journalistic model, there is a big growth in online, open-access journals each with different approaches to peer review. But peer review is impossible to define<\/a> and reviewing research before it is published can be fraught<\/a> with problems<\/a>.<\/p>\n

This is part of the reason why so many published research findings<\/a> are false<\/a>. Alternative publishing models have developed in response to this. Open access<\/a> and post-publication peer review<\/a> are now common.<\/p>\n

This new regime raises questions about what defines academic publishing. Blog posts and journalistic articles can be open access and subject to post-publication peer review, but are they scholarly? New publishing models have also developed their own shortcomings. One problem is the proliferation of predatory open access publishers<\/a>. Some of these appear happy to accept randomly generated articles for publication<\/a>, apparently following peer review.<\/p>\n

The importance of transparency<\/h2>\n

So, what should be considered scholarly output? The key to quality research is that we know what went into producing the reported results. All empirical work should be preceded by a published protocol<\/a>. This should set out \u2013 transparently \u2013 the methods that were used.<\/p>\n

Without one, it\u2019s difficult to reproduce research findings and identify errors. There are plenty of journals that will now publish protocols, such as BMJ Open<\/a>, PeerJ<\/a> or SpringerPlus<\/a>. But publication of a protocol in an open access repository would be sufficient \u2013 it isn\u2019t necessary for it to appear in a peer-reviewed journal.<\/p>\n

It\u2019s important to make any present or potential conflicts of interest clear. This should apply to authors, reviewers and editors. Journal\u2019s disclosure rules are a start, though these are subject to limitations<\/a>. We need more sophisticated mechanisms for use alongside initiatives like ORCID<\/a>, which assigns a unique ID to all researchers.<\/p>\n

In most cases, scholars can share<\/a> the data they have collected and analysed. Making data and analysis files available can help uncover simple errors. The Reinhart-Rogoff-Herndon incident<\/a> is a case in point. Research findings by two Harvard economists were used to justify austerity policies, but these findings were undermined when a fundamental error was found in an Excel file.<\/p>\n

My own field of research \u2013 health economics \u2013 should make cost-effectiveness models<\/a> open. These models often form the basis of decisions about whether or not a particular drug will be available to patients, and yet the methods are often unclear to everyone but the authors. Where data relates to individual participants \u2013 and cannot be anonymised \u2013 this should be made clear to readers and reviewers.<\/p>\n

Shine a light on peer review<\/h2>\n

Evidence suggests<\/a> that two or three peer reviewers will not be able to identify all errors in a manuscript. This is one of the main problems with pre-publication peer review. It\u2019s also one reason why open access is so important in the definition of good science. Paywalls on traditional academic journals restrict the number of people who can check the quality of a publication and can encourage mistaken consensus over published errors. All scholarly output must be open access.<\/p>\n

And so peer review itself should also be transparent. Pre-publication peer review reports should be open and accessible through the journal or a service like Publons<\/a>, a facility for researchers to record their peer review activity. Mechanisms to support post-publication peer review should also be supported. Reviewers should be identifiable as experts in their field. PubMed Commons<\/a> is an example of such a tool.<\/p>\n

Peer review is important, but I believe that post-publication approaches can be more effective. An additional benefit of open evaluation is the potential for better metrics<\/a>.<\/p>\n

Redefining scholarly output<\/h2>\n

Scholarly writing should be distinguishable from other forms of publication by its transparency. We should know exactly how authors arrive at their findings. Findings published in academic journals should be given special credence because of this.<\/p>\n

Academic publishing should be defined by the presence of strict regulations to maximise transparency. Articles that do not meet transparency criteria should not be eligible for research quality assessments, such as the UK\u2019s Research Excellence Framework. Journalists and academic bloggers will not be subject to such strict rules, and their output will differ accordingly.<\/p>\n

Make \u201cgood\u201d science clearer<\/h2>\n

I am by<\/a> no<\/a> means<\/a> the<\/a> first<\/a> to call for such measures. But previous calls have focused on ideas for improving scholastic writing rather than the more fundamental challenge of defining it.<\/p>\n

Transparency no doubt has its costs<\/a>, at least in the short term. But without it, true scholarly output will become increasingly indistinguishable from academics’ other forms of writing.<\/p>\n

Good science should not be defined by whether or not pre-publication peer review takes place, but by the transparency of the research. Some fear that abandoning our current system might<\/a> allow more \u201cbad science\u201d to get through. But we have bad science now, and lots of it. Sunlight is the best disinfectant.<\/p>\n

\n

Next, read: When \u2018exciting\u2019 trumps \u2018honest\u2019 traditional academic journals encourage bad science <\/a><\/p>\n

\"The<\/p>\n

Christopher Sampson does not work for, consult to, own shares in or receive funding from any company or organisation that would benefit from this article, and has no relevant affiliations.<\/em><\/p>\n

This article was originally published on The Conversation<\/a>.
\nRead the original article<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

By Christopher Sampson, University of Nottingham What is it that sets academic publications apart from articles on The Conversation? Peer review might be your first answer. While The Conversation is built around a journalistic model, there is a big growth in online, open-access journals each with different approaches to peer review. But peer review is […]<\/p>\n","protected":false},"author":39,"featured_media":6549,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[37],"tags":[],"_links":{"self":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/2393"}],"collection":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/users\/39"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/comments?post=2393"}],"version-history":[{"count":2,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/2393\/revisions"}],"predecessor-version":[{"id":6550,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/2393\/revisions\/6550"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media\/6549"}],"wp:attachment":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media?parent=2393"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/categories?post=2393"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/tags?post=2393"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}