{"id":2577,"date":"2014-12-11T05:17:21","date_gmt":"2014-12-11T05:17:21","guid":{"rendered":"http:\/\/www.lifeandnews.com\/articles\/?p=2577"},"modified":"2016-08-26T03:15:15","modified_gmt":"2016-08-26T03:15:15","slug":"computer-science-can-only-help-not-hurt-art-historians","status":"publish","type":"post","link":"https:\/\/www.lifeandnews.com\/articles\/computer-science-can-only-help-not-hurt-art-historians\/","title":{"rendered":"Computer science can only help \u2013 not hurt \u2013 art historians"},"content":{"rendered":"

By Ahmed Elgammal<\/a>, Rutgers University<\/a><\/em><\/p>\n

I was the lead of a team of computer scientists at Rutgers that published a paper this past August titled, \u201cToward Automated Discovery of Artistic Influence.\u201d<\/a> In that paper we reported on our research, where we used object recognition techniques to compare paintings and identify similarities between them in color, form, texture and content. The goal was to classify painting styles and determine how artists may have been influenced by their predecessors.<\/p>\n

Reactions from art historians, critics, and artists ranged from enthusiastic to dismissive. London\u2019s Daily Telegraph reported<\/a> on our submission with the somewhat hyperbolic headline: \u201cCould computers put art historians out of work?\u201d Shortly thereafter, Professor Griselda Pollock, an art historian at University of Leeds, was more critical, writing a piece titled, \u201cComputers can find similarities between paintings \u2013 but art history is about so much more.\u201d<\/a><\/p>\n

It\u2019s clear that there\u2019s a fundamental misunderstanding in the art history community about why a computer vision scientist would be interested in exploring resemblances among works of art.<\/p>\n

For some background: in our research, we analyzed roughly 1,700 digitized images of paintings by 66 masters from the 15th century to the 20th century.<\/p>\n

Our computers noted interesting parallels. For example, Frederic Bazille\u2019s Studio 9 Rue de la Condamine (1870) and Norman Rockwell\u2019s Shuffleton\u2019s Barber Shop (1950) possess strikingly similar compositions.<\/p>\n

Using the results, we created a graphic of the 66 artists used in our study \u2013 what we called a \u201cmap of artists\u201d \u2013 a graphic of artists\u2019 names where proximity implies similarity. The computer also hypothesized about artists whose paintings may been influenced by a predecessor, like Degas and Delacroix. In many cases, these hypotheses matched those of art historians.<\/p>\n

\"\"<\/a><\/figure>\n

Computer generated \u2018map of artists,\u2019 where proximity implies similarity (click to zoom).<\/span>
\nAuthor provided<\/span><\/span><\/p>\n

In her article, Professor Pollock explained that art history is not about tracing influences by comparing form, texture, and color \u2013 what, she noted, is called \u201cconnoisseurial art history,\u201d pioneered in the 19th century by Giovanni Morelli. Professor Pollock went on to (correctly) point out that the discipline of art history has evolved since then: it encompass politics, economics, literature, ideology, theology, philosophy, while embracing the perspectives of contemporary social movements.<\/p>\n

Essentially, she was saying that our research was predicated on a definition of art history that\u2019s outdated.<\/p>\n

However we didn\u2019t make any claims about what art history is or isn\u2019t. We understand that influences between artists is not just about visual similarity \u2013 that, as a discipline, art history requires studying social, personal, ideological, and historical contexts.<\/p>\n

Here\u2019s what we find compelling: when people look at paintings, they can make sophisticated inferences beyond simply recognizing a tree, a chair, or the Christ; they can predict which artist likely did the work, note the painting\u2019s style, its genre, and its period. Learning and judging such complex visual concepts is an impressive ability of human perception.<\/p>\n

Such ability intrigues researchers in my discipline. It\u2019s our ultimate goal to make a machine that passes the traditional Turing test (when an interrogator is unable to guess which of two players is a machine and which is a human). Of course in the case of paintings we can think of a similar test, which I would call the \u201cvisual Turing test.\u201d While passing this test may be a ways off, our results offer an important breakthrough: proof that a machine can learn to discover interesting similarities among paintings that humans can confirm.<\/p>\n

Furthermore, Professor Pollock argued that it\u2019s a fallacy to claim that computers can notice things that humans cannot. Computer vision promises \u2013 and in fact has proven \u2013 that it can overcome human vision\u2019s spectral limitation and quantitative imprecision. In the domain of art, computer vision can offer a level of precise and objective analysis.<\/p>\n

It\u2019s true that influence discovery might be based on a century-old view of art history. But when a child is learning to walk, she first crawls before taking her first steps. Later, she runs.<\/p>\n

Artificial Intelligence is still in its infancy, especially as it tries to tackle challenges of increasing complexity. If we hope to make a machine understand sophisticated connections between artists, it\u2019s only natural to initially approach the challenge the same way Giovanni Morelli and connoisseurial art historians did a century ago.<\/p>\n

The humanities are becoming digitized; paintings, photographs, letters, centuries-old books, volumes of journals and magazines \u2013 all are increasingly available online.<\/p>\n

And perhaps there will be a day when the technology could evolve to look at the historical, social, and personal context of art \u2013 a day when computers could mine these vast stores of heterogeneous data to conduct an analysis of artistic influences that goes beyond<\/em> the connoisseurial approach.<\/p>\n

At that point, it would be up to art historians to figure out how to best utilize these technological advances.<\/p>\n

Do we hope to put art historians out of work? Hardly. If anything, I tend to agree with a November 10 Washington Post article<\/a> headline about our research: \u201cComputer Science Putting Art Analysis on Faster Track,\u201d it reads.<\/p>\n

\"The<\/p>\n

This article was originally published on The Conversation<\/a>.
\nRead the original article<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

By Ahmed Elgammal, Rutgers University I was the lead of a team of computer scientists at Rutgers that published a paper this past August titled, \u201cToward Automated Discovery of Artistic Influence.\u201d In that paper we reported on our research, where we used object recognition techniques to compare paintings and identify similarities between them in color, […]<\/p>\n","protected":false},"author":39,"featured_media":7324,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/2577"}],"collection":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/users\/39"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/comments?post=2577"}],"version-history":[{"count":2,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/2577\/revisions"}],"predecessor-version":[{"id":7325,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/posts\/2577\/revisions\/7325"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media\/7324"}],"wp:attachment":[{"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/media?parent=2577"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/categories?post=2577"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lifeandnews.com\/articles\/wp-json\/wp\/v2\/tags?post=2577"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}