The dark side of AI: recommend and manipulate (Ep. 90)

Published: Dec. 11, 2019, 10:07 a.m.

b'In 2017 a research group at the University of Washington did a study on the Black Lives Matter movement on Twitter. They constructed what they call a\\xa0\\u201cshared audience graph\\u201d\\xa0to analyse the different groups of audiences participating in the debate, and found an alignment of the groups with the political left and political right, as well as clear alignments with groups participating in other debates, like environmental issues, abortion issues and so on. In simple terms, someone who is pro-environment, pro-abortion, left-leaning, is also supportive of the\\xa0Black Lives Matter\\xa0movement, and viceversa.\\nF: Ok, this seems to make sense, right? But\\u2026 I suspect there is more to this story?\\nSo far, yes\\u2026. What they did not expect to find, though, was a pervasive network of Russian accounts participating in the debate, which turned out to be orchestrated by the Internet Research Agency, the not-so-secret Russian secret service agency of internet black ops. The same connected with the US election and Brexit referendum, allegedly.\\xa0\\nF: Are we talking about actual spies? Where are you going with this?\\nBasically, the Russian accounts (part of them human and part of them bots) were infiltrating all aspects of the debate, both on the left and on the right side, and always taking the most extreme stances on any particular aspect of the debate. The aim was to radicalise the conversation, to make it more and more extreme, in a tactic of divide-and-conquer: turn the population against itself in an online civil war, push for policies that normally would be considered too extreme (for instance, give tanks to the police to control riots, force a curfew, try to ban Muslims from your country). Chaos and unrest have repercussions on international trade and relations, and can align to foreign interests.\\nF: It seems like a pretty indirect and convoluted way of influencing a foreign power\\u2026\\nYou might think so, but you are forgetting social media. This sort of operation is directly exploiting a core feature of internet social media platforms. And that feature, I am afraid, is\\xa0recommender systems.\\nF: Whoa. Let\\u2019s take a step back. Let\\u2019s recap the general features of recommender systems, so we are on the same page.\\xa0\\nThe main purpose of recommender systems is to recommend people the same items similar people show an interest in.Let\\u2019s think about books and readers. The general idea is to find a way to predict the best book to the best reader. Amazon is doing it, Netflix is doing it, probably the bookstore down the road does that too, just on a smaller scale.Some of the most common methods to implement recommender systems, use concepts such as cosine/correlation similarity, matrix factorization, neural autoencoders and sequence predictors.\\nThe major issue of recommender systems is in their validation. Even though validation occurs in a way that is similar to many machine learning methods, one should recommend a set of items first (in production) and measure the efficacy of such a recommendation. But, recommending is already altering the entire scenario, a bit in the flavour of the\\xa0Heisenberg principle of uncertainty.\\xa0\\nF: In the attention economy, the business model is to monetise the time the user spends on a platform, by showing them ads. Recommender systems are crucial for this purpose.Chiara, you are saying that these algorithms have effects that are problematic?\\nAs you say, recommender systems exist because the business model of social media platforms is to monetise attention. The most effective way to keep users\\u2019 attention is to show them stuff they could show an interest in.In order to do that, one must segment the audience to find the best content for each user. But then, for each user, how do you keep them engaged, and make them consume more content?\\xa0\\nF: You\\u2019re going to say the word \\u201cfilter bubble\\u201d very soon.\\nSpot on. To keep the user on the platform, you start by showing them content that they are interested in, and that agrees with their opinion.'