{"id":1774,"date":"2014-10-21T20:23:09","date_gmt":"2014-10-21T20:23:09","guid":{"rendered":"http:\/\/www.lifeandnews.com\/articles\/?p=1774"},"modified":"2016-08-20T21:49:47","modified_gmt":"2016-08-20T21:49:47","slug":"the-risks-of-blowing-your-own-trumpet-too-soon-on-research","status":"publish","type":"post","link":"https:\/\/www.lifeandnews.com\/articles\/the-risks-of-blowing-your-own-trumpet-too-soon-on-research\/","title":{"rendered":"The risks of blowing your own trumpet too soon on research"},"content":{"rendered":"<p>By <a href=\"http:\/\/theconversation.com\/profiles\/daniel-price-129673\">Daniel Price<\/a><em>, Monash University<\/em><\/p>\n<p><em>UNDERSTANDING RESEARCH: What do we actually mean by research and how does it help inform our understanding of things? Today a cautionary tale of why you should be careful of some new announcements made in the name of science.<\/em><\/p>\n<hr \/>\n<p>It was dubbed a \u201c<a href=\"http:\/\/www.bbc.co.uk\/news\/science-environment-26605974\">spectacular<\/a>\u201d discovery \u2013\u00a0even \u201c<a href=\"http:\/\/www.bbc.co.uk\/news\/science-environment-26605974\">Nobel prize-worthy<\/a>\u201d.<\/p>\n<p>But the March announcement <a href=\"http:\/\/www.youtube.com\/watch?v=Iasqtm1prlI\">via a press conference<\/a> that researchers at the <a href=\"http:\/\/bicepkeck.org\/\">BICEP2<\/a> facility in Antarctica had detected the imprint of relic gravitational waves from a period of super-fast expansion in the early universe now looks <a href=\"https:\/\/theconversation.com\/has-dust-clouded-the-discovery-of-gravitational-waves-27177\">a little shaky<\/a>.<\/p>\n<p>As an astrophysicist who works on the interstellar medium, I wouldn\u2019t be surprised if the claimed detection eventually all went away. If so, this episode \u2013\u00a0much like the 2011 faster-than-light neutrinos story (more on that later) \u2013 is a telling example of the dangers of \u201cscience by press conference\u201d.<\/p>\n<p>The BICEP2 team invited the press to Harvard University to announce their result even before it had been refereed, alongside which they posted a now-infamous video of their champagne-on-doorstep announcement to Andrei Linde, one of the theorists whose work they claimed to have proved:<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/theconversation.com\/explainer-what-is-peer-review-27797\">Peer review<\/a> \u2013\u00a0where scientists evaluate the quality of other scientists&#8217; work \u2013 may be the \u201c<a href=\"http:\/\/www.publications.parliament.uk\/pa\/cm201011\/cmselect\/cmsctech\/writev\/856\/m59.htm\">least worst<\/a>\u201c system but it is the foundation on which modern science is built.<\/p>\n<h2>Open to review and scrutiny<\/h2>\n<p>Granted, the BICEP2 results were <a href=\"http:\/\/journals.aps.org\/prl\/pdf\/10.1103\/PhysRevLett.112.241101\">eventually published<\/a> in a June edition of the journal Physical Review Letters \u2013 three months after the the initial announcement \u2013 and some would argue that putting it in the public spotlight involved being scrutinised by hundreds or thousands of expert opinions, instead of just one.<\/p>\n<p>But the claim of discovery in science is a dangerous one, and in my view one best left to the gentle momentum built up over time as a result is confirmed by others and its importance understood.<\/p>\n<p>At the very least it deserves waiting until the refereeing process has been completed, if only to avoid the embarrassment of the whole team should the result not hold up.<\/p>\n<p>Of course, it\u2019s not just in physics that the temptation of science by press conference or by press release exists \u2013\u00a0some notable recent examples include successfully <a href=\"http:\/\/embor.embopress.org\/content\/7\/12\/1193\">cloning a human baby<\/a>.<\/p>\n<p>&nbsp;<\/p>\n<p>Another press release announcement that caught the media\u2019s attention was that Oreos chocolate biscuits are <a href=\"http:\/\/scopeblog.stanford.edu\/2013\/10\/28\/the-disturbing-trend-of-science-by-press-release\/\">as addictive as cocaine<\/a> \u2013 but I\u2019ll examine a couple of examples from my own field in detail.<\/p>\n<h2>BICEP2: flexed or flabby?<\/h2>\n<p>The issue with BICEP2 was a fairly simple one \u2014 to observe the cosmic microwave background (CMB) radiation, the relic radiation from the <a href=\"http:\/\/wmap.gsfc.nasa.gov\/universe\/\">Big Bang<\/a> that fills the universe at microwave wavelengths, you have to first subtract the glow of our own galaxy in the same wavelengths.<\/p>\n<p>Take for example the recent maps (below) of the sky in microwaves from the European Space Agency\u2019s <a href=\"http:\/\/sci.esa.int\/planck\/\">Planck<\/a> satellite.<\/p>\n<figure class=\"align-center zoomable\"><a href=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/58544\/area14mp\/6mg2z82d-1410244187.jpg\"><img src=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/58544\/width668\/6mg2z82d-1410244187.jpg\" alt=\"\" \/><\/a><\/figure>\n<p><span class=\"attribution\"><span class=\"source\">ESA and the Planck Collaboration<\/span><\/span><\/p>\n<p>The big red stripe is the microwave radiation from gas in the Milky Way, which has nothing to do with the microwave radiation from the early universe.<\/p>\n<p>Subtracting this reveals (below) the small fluctuations in temperature from just after the Big Bang, which are the seeds of the galaxies that we see today.<\/p>\n<figure class=\"align-center zoomable\"><a href=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/58542\/area14mp\/cgwk7jb8-1410243977.jpg\"><img src=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/58542\/width668\/cgwk7jb8-1410243977.jpg\" alt=\"\" \/><\/a><\/figure>\n<p><span class=\"attribution\"><span class=\"source\">ESA and the Planck Collaboration<\/span><\/span><\/p>\n<p>A similar procedure applies to the observations of polarised light that was the basis of the claimed gravitational wave detection from BICEP2.<\/p>\n<p>Polarised microwave light in our galaxy is produced by dust grains that spin on their axes and align like mini-compasses with the interstellar magnetic field.<\/p>\n<p>Because the grains all line up in a similar direction this produces polarised light \u2014 precisely the kind of polarised light also produced by gravitational waves in the early universe.<\/p>\n<h2>Now comes the tricky bit<\/h2>\n<p>In subtracting the galaxy, the devil is in the details. The interstellar medium is a complicated place, full of turbulent, messy gas.<\/p>\n<p>Understanding the foreground emission is therefore a complicated business, and one that requires very detailed maps of the galaxy itself (we have a saying in astronomy: \u201cone person\u2019s annoying foreground is another\u2019s data\u201d).<\/p>\n<p>This is precisely what the Planck mission has been doing \u2014 so much so that the best results out of Planck for the first year or two were the exquisite maps they released of the gas and dust in the Milky Way, nothing to do with the cosmic microwave background.<\/p>\n<figure class=\"align-center zoomable\"><a href=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/59692\/area14mp\/mpmb9dzt-1411364241.jpg\"><img src=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/59692\/width668\/mpmb9dzt-1411364241.jpg\" alt=\"\" \/><\/a><\/figure>\n<p><span class=\"caption\">The sun sets behind BICEP2 (in the foreground) and the South Pole Telescope (in the background).<\/span><br \/>\n<span class=\"attribution\"><a class=\"source\" href=\"http:\/\/bicepkeck.org\/visuals.html\" rel=\"nofollow\">Steffen Richter, Harvard University<\/a><\/span><\/p>\n<p>By contrast, detailed maps of the dust polarisation from the Milky Way is precisely what the BICEP2 team were missing, so they had to rely on models of the dust emission to do the subtraction rather than actual maps.<\/p>\n<p>So what? Well, it turns out they may have underestimated the foreground emission from dust, and therefore over-estimated the significance of any claimed gravitational wave detection.<\/p>\n<p>Happily for science, we\u2019ll be able to resolve this fairly soon: accurate maps of the polarised dust emission are exactly what the Planck team have been constructing, so they\u2019ll be able to do a much better job of subtracting the foreground.<\/p>\n<p>Indeed, Planck maps of the foreground dust emission, though not yet covering the patch of sky observed by BICEP2, are already being used to refine the foreground estimates, and these revised estimates are what is casting doubt on the claimed detection.<\/p>\n<h2>The need for quality control<\/h2>\n<p>Of course this is not the only case of scientists making their announcement too soon, before the research has been put forward for review.<\/p>\n<p>Back in 2011 a team of physicists in Europe called a press conference to announce that they had measured neutrinos <a href=\"http:\/\/news.sciencemag.org\/2011\/09\/neutrinos-travel-faster-light-according-one-experiment?ref=hp\">travelling faster than the speed of light<\/a>.<\/p>\n<p>The claim made <a href=\"http:\/\/www.theguardian.com\/science\/2011\/sep\/22\/faster-than-light-particles-neutrinos\">headlines<\/a> around the world because such as result would be in contravention of Einstein\u2019s special theory of relativity that nothing could travel faster than light.<\/p>\n<p>One prominent UK physicist and broadcaster, <a href=\"http:\/\/www.jimal-khalili.com\/\">Jim Al-Khalili<\/a>, even promised to eat his boxer shorts if the results were found to be true.<\/p>\n<figure class=\"align-center zoomable\"><a href=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/59690\/area14mp\/j5zjxcrr-1411363627.png\"><img src=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/59690\/width668\/j5zjxcrr-1411363627.png\" alt=\"\" \/><\/a><\/figure>\n<p><span class=\"attribution\"><a class=\"source\" href=\"https:\/\/twitter.com\/jimalkhalili\/status\/117160630527594496\" rel=\"nofollow\">@jimalkhalili<\/a><\/span><\/p>\n<p>Well the claim was soon tested and <a href=\"http:\/\/news.sciencemag.org\/2012\/06\/once-again-physicists-debunk-faster-light-neutrinos\">debunked by other teams of physicists<\/a> who could not repeat the results. That lead to <a href=\"http:\/\/news.sciencemag.org\/europe\/2012\/03\/leaders-faster-light-experiment-step-down\">some resignations<\/a> from the original team that first made the claim.<\/p>\n<p>The erroneous result was eventually blamed on some <a href=\"http:\/\/www.theguardian.com\/science\/2012\/jun\/08\/neutrino-researchers-einstein-right\">faulty wiring<\/a> in the experiment\u2019s equipment.<\/p>\n<h2>Let\u2019s bring back humility in science<\/h2>\n<p>Rather than the endless chasing of headlines and press-conference-worthy claims of results I\u2019d like to see more considered papers such as the <a href=\"http:\/\/adsabs.harvard.edu\/abs\/1965ApJ...142..419P\">original discovery paper<\/a> for the cosmic microwave background, published in the Astrophysical Journal in 1965.<\/p>\n<p>It landed astrophysicists <a href=\"http:\/\/www.nobelprize.org\/nobel_prizes\/physics\/laureates\/1978\/penzias-facts.html\">Arno Penzias<\/a> and <a href=\"http:\/\/www.nobelprize.org\/nobel_prizes\/physics\/laureates\/1978\/wilson-facts.html\">Robert Wilson<\/a> the <a href=\"http:\/\/www.nobelprize.org\/nobel_prizes\/physics\/laureates\/1978\/\">1978 Nobel Prize in Physics<\/a>.<\/p>\n<p>And what was the title of this ground breaking research? Just simply \u201cA Measurement of Excess Antenna Temperature at 4,080Mc\/s\u201d and published in a regular journal. Possible explanations were left to others.<\/p>\n<hr \/>\n<p><strong>This article is part of a series on <a href=\"https:\/\/theconversation.com\/au\/topics\/understanding-research\">Understanding Research<\/a>.<\/strong><\/p>\n<p><strong>Further reading:<\/strong><br \/>\n<strong><a href=\"https:\/\/theconversation.com\/why-research-beats-anecdote-in-our-search-for-knowledge-30654\">Why research beats anecdote in our search for knowledge<\/a><\/strong><br \/>\n<strong><a href=\"https:\/\/theconversation.com\/clearing-up-confusion-between-correlation-and-causation-30761\">Clearing up confusion between correlation and causation<\/a><\/strong><br \/>\n<strong><a href=\"https:\/\/theconversation.com\/wheres-the-proof-in-science-there-is-none-30570\">Where\u2019s the proof in science? There is none<\/a><\/strong><br \/>\n<strong><a href=\"https:\/\/theconversation.com\/positives-in-negative-results-when-finding-nothing-means-something-26400\">Positives in negative results: when finding \u2018nothing\u2019 means something<\/a><\/strong><br \/>\n<strong><a href=\"https:\/\/theconversation.com\/how-to-find-the-knowns-and-unknowns-in-any-research-26338\">How to find the knowns and unknowns in any research<\/a><\/strong><br \/>\n<strong><a href=\"https:\/\/theconversation.com\/how-myths-and-tabloids-feed-on-anomalies-in-science-29337\">How myths and tabloids feed on anomalies in science<\/a><\/strong><br \/>\n<strong><a href=\"https:\/\/theconversation.com\/the-10-stuff-ups-we-all-make-when-interpreting-research-30816\">The 10 stuff-ups we all make when interpreting research<\/a><\/strong><\/p>\n<p><img loading=\"lazy\" src=\"https:\/\/counter.theconversation.edu.au\/content\/31362\/count.gif\" alt=\"The Conversation\" width=\"1\" height=\"1\" \/><\/p>\n<p><em>Daniel Price does not work for, consult to, own shares in or receive funding from any company or organisation that would benefit from this article, and has no relevant affiliations.<\/em><\/p>\n<p>This article was originally published on <a href=\"http:\/\/theconversation.com\">The Conversation<\/a>.<br \/>\nRead the <a href=\"http:\/\/theconversation.com\/the-risks-of-blowing-your-own-trumpet-too-soon-on-research-31362\">original article<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>By Daniel Price, Monash University UNDERSTANDING RESEARCH: What do we actually mean by research and how does it help inform our understanding of things? Today a cautionary tale of why you should be careful of some new announcements made in the name of science. It was dubbed a \u201cspectacular\u201d discovery \u2013\u00a0even \u201cNobel prize-worthy\u201d. But the [&hellip;]<\/p>\n","protected":false},"author":39,"featured_media":6911,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[36],"tags":[],"_links":{"self":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/1774"}],"collection":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/users\/39"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/comments?post=1774"}],"version-history":[{"count":2,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/1774\/revisions"}],"predecessor-version":[{"id":6912,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/1774\/revisions\/6912"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media\/6911"}],"wp:attachment":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media?parent=1774"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/categories?post=1774"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/tags?post=1774"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}