{"id":10388,"date":"2017-11-06T07:13:29","date_gmt":"2017-11-06T07:13:29","guid":{"rendered":"http:\/\/www.lifeandnews.com\/articles\/?p=10388"},"modified":"2017-11-07T07:16:06","modified_gmt":"2017-11-07T07:16:06","slug":"how-citizen-investigators-can-collaborate-on-crowdsourced-fact-checking","status":"publish","type":"post","link":"https:\/\/www.lifeandnews.com\/articles\/how-citizen-investigators-can-collaborate-on-crowdsourced-fact-checking\/","title":{"rendered":"How citizen investigators can collaborate on crowdsourced fact-checking"},"content":{"rendered":"<p><span><a href=\"https:\/\/theconversation.com\/profiles\/ricky-j-sethi-246397\">Ricky J. Sethi<\/a>, <em><a href=\"http:\/\/theconversation.com\/institutions\/fitchburg-state-university-1668\">Fitchburg State University<\/a><\/em><\/span><\/p>\n<p>It can be hard to know what is true online. <a href=\"https:\/\/www.questia.com\/library\/89579635\/pr-a-social-history-of-spin\">Propaganda and misinformation<\/a> have a <a href=\"http:\/\/my.ilstu.edu\/%7Ejkshapi\/Lippmann%20Phantom.pdf\">much longer history<\/a> than the internet, of course. But the <a href=\"http:\/\/www.nber.org\/papers\/w23089\">rapid proliferation of \u201cfake news\u201d on social media<\/a>, and its tendency to <a href=\"http:\/\/dx.doi.org\/10.1080\/10410236.2017.1384433\">extend into mainstream news coverage<\/a>, can obscure the difference between credible information and inaccuracies.<\/p>\n<p>Modern attempts to combat the spread of falsehoods have focused mainly on computerized, automated tools. They flag <a href=\"https:\/\/doi.org\/10.1145\/2740908.2742572\">previously identified hoaxes<\/a>; or <a href=\"http:\/\/dl.acm.org\/citation.cfm?id=2857152\">automatically detect fake news<\/a> using natural language processing techniques; or track the <a href=\"http:\/\/doi.org\/10.1038\/540525a\">virus-like transmission<\/a> of hoaxes. However, none of them focuses on verifying the statements contained in news and opinion articles.<\/p>\n<p>Research reveals that the best <a href=\"http:\/\/trove.nla.gov.au\/work\/14127728\">remedy for propaganda and misinformation<\/a> intended to <a href=\"http:\/\/doi.org\/10.1525\/hsns.2012.42.1.1\">manipulate public opinion<\/a> is helping readers engage in <a href=\"http:\/\/dx.doi.org\/10.1080\/00405849309543594\">critical thinking<\/a> and evidence-based reasoning. My team conducts research on how critical thinking emerges in online communities and has recently developed a way for groups of people to engage in collective critical reasoning. This approach can help confirm or invalidate controversial or complex statements, and explain the evaluation clearly.<\/p>\n<h2>Breaking down claims into components<\/h2>\n<p>Our method involves analyzing claims through a formal structure called <a href=\"https:\/\/philpapers.org\/rec\/JOHTRO-40\">argumentation<\/a>. Most people dislike arguments, thinking of them as involving bickering or fighting. But <a href=\"https:\/\/stemeducationjournal.springeropen.com\/articles\/10.1186\/s40594-015-0020-1\">formal argumentation<\/a> is a <a href=\"http:\/\/www.springer.com\/gp\/book\/9781402049378\">method of working through ideas or hypotheses<\/a> critically and systematically. One of our innovations is to allow groups of people to work through this process together, with each person handling small pieces that can be assembled into a complete evaluation of a statement or claim.<\/p>\n<figure class=\"align-center zoomable\">\n            <a href=\"https:\/\/images.theconversation.com\/files\/191739\/original\/file-20171024-13536-xbxyi3.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\"><img alt=\"\" src=\"https:\/\/images.theconversation.com\/files\/191739\/original\/file-20171024-13536-xbxyi3.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\"><\/a><figcaption>\n              <span class=\"caption\"><\/span><br \/>\n              <span class=\"attribution\"><span class=\"source\">Ricky Sethi<\/span>, <a class=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/\">CC BY-ND<\/a><\/span><br \/>\n            <\/figcaption><\/figure>\n<p>The argumentation process starts with a question. Let\u2019s use, for an example, the question that served as the origin of the term \u201c<a href=\"https:\/\/en.wikipedia.org\/wiki\/Alternative_facts\">alternative facts<\/a>.\u201d (There is also a legal term \u201c<a href=\"http:\/\/abovethelaw.com\/2017\/02\/alternative-facts-are-nothing-new-for-lawyers\/\">alternative facts<\/a>,\u201d which is different.)<\/p>\n<p>The question is, \u201cWere the crowds larger at Donald Trump\u2019s inauguration than at Barack Obama\u2019s?\u201d This question might have two possible answers, or in the terms of argumentation, \u201cstances\u201d: yes or no.<\/p>\n<p>Each stance \u2013 for instance, a person saying \u201cyes\u201d \u2013 must be supported by one or more \u201cclaims.\u201d A claim might be, \u201cDonald Trump\u2019s inauguration attendance can be measured by that day\u2019s ridership numbers on the local public transit system.\u201d<\/p>\n<p>Claims are supported by \u201cevidence\u201d \u2013 such as \u201cPer WMATA, the Washington area transit authority, as of 11 a.m., 193,000 trips had been taken on the city\u2019s subway system.\u201d <\/p>\n<p>The evidence, in turn, relies upon a \u201csource,\u201d such as a <a href=\"http:\/\/www.cnn.com\/2017\/01\/20\/politics\/donald-trump-barack-obama-inauguration-crowd-size\/\">CNN article<\/a> providing that data. <\/p>\n<p>Other evidence might shed additional light on the matter. For instance, <a href=\"http:\/\/www.cnn.com\/2017\/01\/20\/politics\/donald-trump-barack-obama-inauguration-crowd-size\/\">that same source CNN article<\/a> provides an item of evidence that gives useful context by refuting the initial stance of yes: \u201cAt the same hour in 2009, that number was 513,000, according to WMATA.\u201d <\/p>\n<h2>Using our system<\/h2>\n<p>On our <a href=\"http:\/\/verify-alt-facts.com\/\">prototype website<\/a>, users can create new inquiries or engage in ongoing ones. To fact-check a statement, for example, a user might post an assertion someone made in the news or on social media. Other users could then contribute related stances, claims, evidence and sources. Each addition helps flesh out the formal argument structure with additional information. <\/p>\n<figure class=\"align-center zoomable\">\n            <a href=\"https:\/\/images.theconversation.com\/files\/192127\/original\/file-20171026-13355-hsjpvx.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\"><img alt=\"\" src=\"https:\/\/images.theconversation.com\/files\/192127\/original\/file-20171026-13355-hsjpvx.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\"><\/a><figcaption>\n              <span class=\"caption\"><\/span><br \/>\n              <span class=\"attribution\"><span class=\"source\">Ricky Sethi<\/span>, <a class=\"license\" href=\"http:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/\">CC BY-ND<\/a><\/span><br \/>\n            <\/figcaption><\/figure>\n<p>As an argument is constructed, users can examine the information presented and evaluate it for themselves. They can rate particular contributions as helpful (or unhelpful), and even rate other users themselves as reliable or less so. They can also filter arguments based upon the properties of a source, evidence, user or claim, including the emotional content. In this way, users can examine a preexisting argument and decide for themselves which stance is supported for a given set of criteria.<\/p>\n<p>Providing new facts alone, however, can lead to something called the \u201c<a href=\"https:\/\/doi.org\/10.1007\/s11109-010-9112-2\">backfire effect<\/a>,\u201d where giving people additional information can, counterintuitively, lead to users\u2019 opinions hardening despite evidence to the contrary. Fortunately, recent research in educational psychology suggests that thinking through material <a href=\"http:\/\/www.emotionalcompetency.com\/papers\/plutchiknatureofemotions%202001.pdf\">can evoke emotions<\/a>, such as <a href=\"http:\/\/dx.doi.org\/10.1080\/09515089.2016.1262536\">surprise and frustration<\/a>, which can <a href=\"http:\/\/doi.org\/10.1080\/0163853X.2015.1136507\">mediate this backfire effect<\/a>. <\/p>\n<p>Our prototype system incorporates emotions as well, by letting users rate how they feel about claims. Following <a href=\"http:\/\/study.com\/academy\/lesson\/robert-plutchiks-wheel-of-emotions-lesson-quiz.html\">Plutchik\u2019s wheel of emotion<\/a>, users can rate where their feelings fall on four emotional ranges: Contented \u2192 Angry, Happy \u2192 Sad, Trust \u2192 Distrust and Likely \u2192 Unlikely. This helps us research the potential extent of the backfire effect and continue to study ways to overcome it.<\/p>\n<h2>Engaging the social network<\/h2>\n<p>We have also added a social network component to our system. Some people might want to just browse existing arguments, while others might want to contribute a claim or evidence. We organize community members to ensure that users who contribute are qualified to do so. <\/p>\n<p>Viewers can ask questions and examine the arguments assembled by others. Contributors are users with some amount of expertise or background, who are authorized to add claim, evidence and source information. And moderators guide the construction of the argument, matching contributors to new questions and evaluating contributions to ensure quality.<\/p>\n<p>This structure helps our system adapt to different purposes, including managing discussions among experts within a certain field or conducting threaded discussions between students and teachers in online classes. A site like the <a href=\"https:\/\/www.wikitribune.com\/\">WikiTribune<\/a> news platform proposed by Jimmy Wales, co-founder of Wikipedia, could use a version of our approach \u2013 perhaps with a different interface \u2013 to build and support different sections of articles. For example, WikiTribune\u2019s reporters could be represented by contributors while their editors would be the moderators in our approach. In addition, the various parts of a story could be broken down as stances or claims in an argumentation structure when modeled using our framework. <\/p>\n<p>Even existing social networking sites like <a href=\"https:\/\/www.facebook.com\/\">Facebook<\/a> could set up a section of its site for people to engage in collaborative fact-checking and help combat the spread of fake news. People could see how different groups they\u2019re connected to build and filter these arguments, and gauge the emotional content of aspects of those arguments.<\/p>\n<p><img loading=\"lazy\" src=\"https:\/\/counter.theconversation.com\/content\/76890\/count.gif?distributor=republish-lightbox-basic\" alt=\"The Conversation\" width=\"1\" height=\"1\" \/>It\u2019s not yet clear whether crowdsourcing fact-checking is the best way to verify alternative facts, and even if so, whether our approach is the best way to manage the process. But in the end, getting people to engage in evidence-based reasoning can have benefits well beyond identifying specific instances of \u201cfake news\u201d \u2013 it can teach users the critical thinking skills needed to detect and evaluate misinformation and fake news they may encounter in the future.<\/p>\n<p><span><a href=\"https:\/\/theconversation.com\/profiles\/ricky-j-sethi-246397\">Ricky J. Sethi<\/a>, Assistant Professor of Computer Science, <em><a href=\"http:\/\/theconversation.com\/institutions\/fitchburg-state-university-1668\">Fitchburg State University<\/a><\/em><\/span><\/p>\n<p>This article was originally published on <a href=\"http:\/\/theconversation.com\">The Conversation<\/a>. Read the <a href=\"https:\/\/theconversation.com\/how-citizen-investigators-can-collaborate-on-crowdsourced-fact-checking-76890\">original article<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Ricky J. Sethi, Fitchburg State University It can be hard to know what is true online. Propaganda and misinformation have a much longer history than the internet, of course. But the rapid proliferation of \u201cfake news\u201d on social media, and its tendency to extend into mainstream news coverage, can obscure the difference between credible information [&hellip;]<\/p>\n","protected":false},"author":44,"featured_media":10389,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[3410],"tags":[],"_links":{"self":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/10388"}],"collection":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/users\/44"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/comments?post=10388"}],"version-history":[{"count":1,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/10388\/revisions"}],"predecessor-version":[{"id":10390,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/10388\/revisions\/10390"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media\/10389"}],"wp:attachment":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media?parent=10388"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/categories?post=10388"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/tags?post=10388"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}