{"id":4742,"date":"2016-07-13T18:40:52","date_gmt":"2016-07-13T18:40:52","guid":{"rendered":"http:\/\/www.lifeandnews.com\/articles\/?p=4742"},"modified":"2019-04-06T09:03:06","modified_gmt":"2019-04-06T09:03:06","slug":"how-twitter-gives-scientists-a-window-into-human-happiness-and-health","status":"publish","type":"post","link":"https:\/\/www.lifeandnews.com\/articles\/how-twitter-gives-scientists-a-window-into-human-happiness-and-health\/","title":{"rendered":"How Twitter gives scientists a window into human happiness and health"},"content":{"rendered":"<p><span><a href=\"http:\/\/theconversation.com\/profiles\/lewis-mitchell-266859\">Lewis Mitchell<\/a>, <em><a href=\"http:\/\/theconversation.com\/institutions\/university-of-adelaide\">University of Adelaide<\/a><\/em><\/span><\/p>\n<p>Since its public launch 10 years ago, Twitter has been used as a social networking platform among friends, an instant messaging service for smartphone users and a promotional tool for corporations and politicians.<\/p>\n<p>But it\u2019s also been an invaluable source of data for researchers and scientists \u2013 like myself \u2013 who want to study how humans feel and function within complex social systems.<\/p>\n<p>By analyzing tweets, we\u2019ve been able to observe and collect data on the social interactions of millions of people \u201cin the wild,\u201d outside of controlled laboratory experiments.<\/p>\n<p>It\u2019s enabled us to develop tools for monitoring the <a href=\"http:\/\/www.hedonometer.org\">collective emotions of large populations<\/a>, find the <a href=\"http:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0064417\">happiest places in the United States<\/a> and much more.<\/p>\n<p>So how, exactly, did Twitter become such a unique resource for computational social scientists? And what has it allowed us to discover?<\/p>\n<h2>Twitter\u2019s biggest gift to researchers<\/h2>\n<p>On July 15, 2006, Twittr (as it was then known) <a href=\"https:\/\/gigaom.com\/2006\/07\/15\/valleys-all-twttr\/\">publicly<\/a> <a href=\"http:\/\/www.bizstone.com\/2006\/07\/let-there-be-twttr.html\">launched<\/a> as a \u201cmobile service that helps groups of friends bounce random thoughts around with SMS.\u201d The ability to send free 140-character group texts drove many early adopters (myself included) to use the platform.<\/p>\n<p>With time, the number of users <a href=\"http:\/\/www.statista.com\/statistics\/282087\/number-of-monthly-active-twitter-users\/\">exploded<\/a>: from 20 million in 2009 to 200 million in 2012 and 310 million today. Rather than communicating directly with friends, users would simply tell their followers how they felt, respond to news positively or negatively, or crack jokes.<\/p>\n<p>For researchers, Twitter\u2019s biggest gift has been the provision of large quantities of open data. Twitter was one of the first major social networks to provide data samples through something called Application Programming Interfaces (APIs), which enable researchers to query Twitter for specific types of tweets (e.g., tweets that contain certain words), as well as information on users.<\/p>\n<p>This led to an explosion of research projects exploiting this data. Today, a Google Scholar search for \u201cTwitter\u201d produces six million hits, compared with five million for \u201cFacebook.\u201d The difference is especially striking given that Facebook has roughly <a href=\"http:\/\/www.statista.com\/statistics\/272014\/global-social-networks-ranked-by-number-of-users\/\">five times as many users as Twitter<\/a> (and is two years older).<\/p>\n<p>Twitter\u2019s generous data policy undoubtedly led to some excellent free publicity for the company, as interesting scientific studies got picked up by the mainstream media.<\/p>\n<h2>Studying happiness and health<\/h2>\n<p>With traditional census data slow and expensive to collect, open data feeds like Twitter have the potential to provide a real-time window to see changes in large populations.<\/p>\n<p>The University of Vermont\u2019s <a href=\"http:\/\/compstorylab.org\">Computational Story Lab<\/a> was founded in 2006 and studies problems across applied mathematics, sociology and physics. Since 2008, the Story Lab has collected billions of tweets through Twitter\u2019s \u201cGardenhose\u201d feed, an API that streams a random sample of 10 percent of all public tweets in real time.<\/p>\n<p>I spent three years at the Computational Story Lab and was lucky to be a part of many interesting studies using this data. For example, we developed a <a href=\"http:\/\/www.hedonometer.org\">hedonometer<\/a> that measures the happiness of the Twittersphere in real time. By focusing on geolocated tweets sent from smartphones, we were able to <a href=\"http:\/\/hedonometer.org\/maps.html\">map<\/a> the happiest places in the United States. Perhaps unsurprisingly, we found <a href=\"http:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0064417\">Hawaii to be the happiest state and wine-growing Napa the happiest city<\/a> for 2013.<\/p>\n<figure class=\"align-center zoomable\">\n            <a href=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/130034\/area14mp\/image-20160711-9277-1y6iuyy.png\"><img alt=\"\" src=\"https:\/\/62e528761d0685343e1c-f3d1b99a743ffa4142d9d7f1978d9686.ssl.cf2.rackcdn.com\/files\/130034\/width754\/image-20160711-9277-1y6iuyy.png\"><\/a><figcaption>\n              <span class=\"caption\">A map of 13 million geolocated U.S. tweets from 2013, colored by happiness, with red indicating happiness and blue indicating sadness.<\/span><br \/>\n              <span class=\"attribution\"><a class=\"source\" href=\"http:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0064417\">PLOS ONE<\/a>, <span class=\"license\">Author provided<\/span><\/span><br \/>\n            <\/figcaption><\/figure>\n<p>These studies had deeper applications: Correlating Twitter word usage with demographics helped us understand underlying socioeconomic patterns in cities. For example, we could link word usage with health factors like obesity, so we built a <a href=\"http:\/\/panometer.org\/instruments\/lexicocalorimeter\/\">lexicocalorimeter<\/a> to measure the \u201ccaloric content\u201d of social media posts. Tweets from a particular region that mentioned high-calorie foods increased the \u201ccaloric content\u201d of that region, while tweets that mentioned exercise activities decreased our metric. We found that this simple measure <a href=\"http:\/\/arxiv.org\/abs\/1507.05098\">correlates with other health and well-being metrics<\/a>. In other words, tweets were able to give us a snapshot, at a specific moment in time, of the overall health of a city or region.<\/p>\n<p>Using the richness of Twitter data, we\u2019ve also been able to <a href=\"http:\/\/www.nature.com\/articles\/srep02625\">see people\u2019s daily movement patterns in unprecedented detail<\/a>. Understanding human mobility patterns, in turn, has the capacity to transform disease modeling, opening up the new field of <a href=\"http:\/\/dx.doi.org\/10.1371\/journal.pcbi.1002616\">digital epidemiology<\/a>.<\/p>\n<p>For other studies, we looked into whether travelers express greater happiness on Twitter than those who stay at home (answer: they do) and if <a href=\"http:\/\/www.uvm.edu\/storylab\/2012\/07\/13\/if-youre-happy-and-we-know-it-are-your-friends\/\">happy individuals tend to stick together in a social network<\/a> (again, they do). Indeed, <a href=\"http:\/\/www.pnas.org\/content\/112\/8\/2389.abstract\">positivity appears to be baked into language itself<\/a>, in the sense that we have more positive words than negative words. This wasn\u2019t the case just on Twitter but across a variety of different media (e.g., books, movies and newspapers) and languages.<\/p>\n<p>These studies \u2013 and thousands of others like them from around the world \u2013 were  possible only thanks to Twitter.<\/p>\n<h2>The next 10 years<\/h2>\n<p>So what can we expect to learn from Twitter over the next 10 years?<\/p>\n<p>Some of the most exciting work currently involves connecting social media data with mathematical models to predict population-level phenomena such as disease outbreaks. Researchers have already had some success in augmenting disease models with Twitter data to forecast influenza, notably the <a href=\"http:\/\/fluoutlook.org\">FluOutlook<\/a> platform developed by Northeastern University and the Institute for Scientific Interchange.<\/p>\n<p>Still, a number of challenges remain. Social media data suffer from a very low \u201csignal-to-noise ratio.\u201d In other words, the tweets that are relevant to a particular study are often drowned out by irrelevant \u201cnoise.\u201d<\/p>\n<p>Therefore, we must continuously be conscious of what\u2019s been dubbed \u201c<a href=\"http:\/\/gking.harvard.edu\/files\/gking\/files\/0314policyforumff.pdf\">big data hubris<\/a>\u201d when developing new methods and not be overconfident of our results. Connected with this should be the aim to produce interpretable \u201cglass-box\u201d predictions from these data (as opposed to \u201cblack-box\u201d predictions, in which the algorithm is hidden or not clear).<\/p>\n<p>Social media data are often (fairly) criticized for being a small, <a href=\"https:\/\/arxiv.org\/abs\/1403.7400\">unrepresentative sample<\/a> of the wider population. One of the major challenges for researchers is figuring out how to account for such skewed data in statistical models. While <a href=\"http:\/\/www.pewinternet.org\/2015\/10\/08\/social-networking-usage-2005-2015\/\">more people are using social media every year<\/a>, we must continue to try to understand the biases in this data. For example, the data still tend to overrepresent younger individuals at the expense of older populations.<\/p>\n<p>Only after developing better bias correction methods will researchers be able to make fully confident predictions from tweets.<\/p>\n<p><img loading=\"lazy\" alt=\"The Conversation\" height=\"1\" src=\"https:\/\/counter.theconversation.edu.au\/content\/62255\/count.gif\" width=\"1\" \/><\/p>\n<p><span><a href=\"http:\/\/theconversation.com\/profiles\/lewis-mitchell-266859\">Lewis Mitchell<\/a>, Lecturer in Applied Mathematics, <em><a href=\"http:\/\/theconversation.com\/institutions\/university-of-adelaide\">University of Adelaide<\/a><\/em><\/span><\/p>\n<p>This article was originally published on <a href=\"http:\/\/theconversation.com\">The Conversation<\/a>. Read the <a href=\"https:\/\/theconversation.com\/how-twitter-gives-scientists-a-window-into-human-happiness-and-health-62255\">original article<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Lewis Mitchell, University of Adelaide Since its public launch 10 years ago, Twitter has been used as a social networking platform among friends, an instant messaging service for smartphone users and a promotional tool for corporations and politicians. But it\u2019s also been an invaluable source of data for researchers and scientists \u2013 like myself \u2013 [&hellip;]<\/p>\n","protected":false},"author":40,"featured_media":4747,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[28,38],"tags":[734,736,730,415,733,731,735,737,732,738,486],"_links":{"self":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/4742"}],"collection":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/users\/40"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/comments?post=4742"}],"version-history":[{"count":1,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/4742\/revisions"}],"predecessor-version":[{"id":4748,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/4742\/revisions\/4748"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media\/4747"}],"wp:attachment":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media?parent=4742"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/categories?post=4742"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/tags?post=4742"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}