Social networks Small world networks 1 Course aim knowledge about concepts in network theory, and being able to apply that knowledge TU/e - 0ZM05/0EM15/0A150 2 The setup in some more detail Network theory and background - - Introduction: what are they, why important … Four basic network arguments Kinds of network data (collection) Small world networks Business networks TU/e - 0ZM05/0EM15/0A150 3 Two approaches to network theory Bottom up (let’s try to understand network characteristics and arguments) as in … “Four network arguments” by Matzat (lecture 2) Top down (let’s have a look at many networks, and try to deduce what is happening from what we see) as in “small world networks” (now) TU/e - 0ZM05/0EM15/0A150 4 What kind of structures do networks have, empirically? Answer: often “small-world”, and often also “scale-free” TU/e - 0ZM05/0EM15/0A150 5 3 important network properties Average Path Length (APL) (<l>) Shortest path between two nodes i and j of a network, averaged across all (pairs of) nodes Clustering coefficient (“cliquishness”) Number of closed triplets / Total number of triplets (= probability that two of my ties are connected) (Shape of the) degree distribution A distribution is “scale free” when P(k), the proportion of nodes with degree k follows this formula, for some value of gamma: TU/e - 0ZM05/0EM15/0A150 6 Example 1 - Small world networks NOTE - Edge of network theory - Not fully understood yet … - … but interesting findings TU/e - 0ZM05/0EM15/0A150 7 Enter: Stanley Milgram (1933-1984) TU/e - 0ZM05/0EM15/0A150 Remember him? 8 The small world phenomenon – Milgram´s (1967) original study Milgram sent packages to several (60? 160?) people in Nebraska and Kansas. Aim was “get this package to <address of person in Boston>” Rule: only send this package to someone whom you know on a first name basis. Aim: try to make the chain as short as possible. Result: average length of a chain is only six “six degrees of separation” TU/e - 0ZM05/0EM15/0A150 9 Milgram’s original study (2) An urban myth? Milgram used only part of the data, actually mainly the ones supporting his claim Many packages did not end up at the Boston address Follow up studies typically small scale TU/e - 0ZM05/0EM15/0A150 10 The small world phenomenon (cont.) “Small world project” has been testing this assertion (not anymore, see http://smallworld.columbia.edu) Email to <address>, otherwise same rules. Addresses were American college professor, Indian technology consultant, Estonian archival inspector, … Conclusion: Low completion rate (384 out of 24,163 = 1.5%) Succesful chains more often through professional ties Succesful chains more often through weak ties (weak ties mentioned about 10% more often) Chain size 5, 6 or 7. TU/e - 0ZM05/0EM15/0A150 11 Some Milgram follow-ups… 6.6! TU/e - 0ZM05/0EM15/0A150 12 TU/e - 0ZM05/0EM15/0A150 13 The Kevin Bacon experiment – Tjaden (+/- 1994) Actors = actors Ties = “has played in a movie with” TU/e - 0ZM05/0EM15/0A150 14 The Kevin Bacon game Can be played at: http://oracleofbacon.org Kevin Bacon number (data might have changed by now) Jack Nicholson: Robert de Niro: Rutger Hauer (NL): Famke Janssen (NL): Bruce Willis: Kl.M. Brandauer (AU): Arn. Schwarzenegger: TU/e - 0ZM05/0EM15/0A150 1 1 2 2 2 2 2 (A few good men) (Sleepers) [Nick Stahl] [Nick Stahl] [Patrick Michael Strange] [Robert Redford] [Kevin Pollak] 15 A search for high Kevin Bacon numbers… 3 TU/e - 0ZM05/0EM15/0A150 2 16 The center of the movie universe Nr 370 (sept 2013) Nr 136 Nr 39 TU/e - 0ZM05/0EM15/0A150 17 The best centers… (2013 + 2011) (Kevin Bacon at place 444 in 2011) (Rutger Hauer at place 39, J.Krabbé 935) TU/e - 0ZM05/0EM15/0A150 18 TU/e - 0ZM05/0EM15/0A150 19 “Elvis has left the building …” TU/e - 0ZM05/0EM15/0A150 20 Think about why these two properties emerge TU/e - 0ZM05/0EM15/0A150 21 We find small average path lengths in all kinds of places… Caenorhabditis Elegans 959 cells Genome sequenced 1998 Nervous system mapped low average path length + cliquishness = small world network Power grid network of Western States 5,000 power plants with high-voltage lines low average path length + cliquishness = small world network TU/e - 0ZM05/0EM15/0A150 22 How weird is that? TU/e - 0ZM05/0EM15/0A150 23 Could there be a simple explanation? Consider a random network: each pair of nodes is connected with a given probability p. This is called an Erdos-Renyi network. NB Erdos was a “Kevin Bacon” long before Kevin Bacon himself!| TU/e - 0ZM05/0EM15/0A150 24 APL is small in random networks [Slide copied from Jari_Chennai2010.pdf] TU/e - 0ZM05/0EM15/0A150 25 [Slide copied from Jari_Chennai2010.pdf] TU/e - 0ZM05/0EM15/0A150 26 But let’s move on to the second network characteristic … TU/e - 0ZM05/0EM15/0A150 27 TU/e - 0ZM05/0EM15/0A150 28 This is how small-world networks are defined: A short Average Path Length and A high clustering coefficient … and a randomly “grown” network does NOT lead to both these small-world properties (the 2nd one fails) TU/e - 0ZM05/0EM15/0A150 29 Source: Leskovec & Faloutsos Networks of the Real-world (1) Information networks: Social networks: people + interactions World Wide Web: hyperlinks Citation networks Blog networks Florence families Organizational networks Communication networks Collaboration networks Sexual networks Collaboration networks Karate club network Technological networks: Power grid Airline, road, river networks Telephone networks Internet Autonomous systems TU/e - 0ZM05/0EM15/0A150 Friendship network Collaboration network Source: Leskovec & Faloutsos Networks of the Real-world (2) Biological networks Language networks metabolic networks food web neural networks gene regulatory networks Yeast protein interactions Semantic network Semantic networks Software networks … Language network TU/e - 0ZM05/0EM15/0A150 Software network Small world networks … so what? You see it a lot around us: for instance in road maps, food chains, electric power grids, metabolite processing networks, neural networks, telephone call graphs and social influence networks may be useful to study them They seem to be useful for a lot of things, and there are reasons to believe they might be useful for innovation purposes (and hence we might want to create them) TU/e - 0ZM05/0EM15/0A150 32 Examples of interesting properties of small world networks TU/e - 0ZM05/0EM15/0A150 33 Synchronizing fireflies … <go to NetLogo> Synchronization speed depends on small-world properties of the network Network characteristics important for “integrating local nodes” TU/e - 0ZM05/0EM15/0A150 34 Combining game theory and networks – Axelrod (1980), Watts & Strogatz (1998?) 1. 2. 3. 4. 5. Consider a given network. All connected actors play the repeated Prisoner’s Dilemma for some rounds After a given number of rounds, the strategies “reproduce” in the sense that the proportion of the more succesful strategies increases in the network, whereas the less succesful strategies decrease or die Repeat 2 and 3 until a stable state is reached. Conclusion: to sustain cooperation, you need a short average distance, and cliquishness (“small worlds”) TU/e - 0ZM05/0EM15/0A150 35 And another peculiarity ... Seems to be useful in “decentralized computing” Imagine a ring of 1,000 lightbulbs Each is on or off Each bulb looks at three neighbors left and right... ... and decides somehow whether or not to switch to on or off. Question: how can we design a rule so that the network can tackle a given GLOBAL (binary) question, for instance the question whether most of the lightbulbs were initially on or off. - As yet unsolved. Best rule gives 82 % correct. - But: on small-world networks, a simple majority rule gets 88% correct. How can local knowledge be used to solve global problems? TU/e - 0ZM05/0EM15/0A150 36 If small-world networks are so interesting and we see them everywhere, how do they arise? (potential answer: through random rewiring of a given structure) TU/e - 0ZM05/0EM15/0A150 37 Strogatz and Watts 6 billion nodes on a circle Each connected to nearest 1,000 neighbors Start rewiring links randomly Calculate average path length and clustering as the network starts to change Network changes from structured to random APL: starts at 3 million, decreases to 4 (!) Clustering: starts at 0.75, decreases to zero (actually to 1 in 6 million) Strogatz and Watts asked: what happens along the way with APL and Clustering? TU/e - 0ZM05/0EM15/0A150 38 Strogatz and Watts (2) “We move in tight circles yet we are all bound together by remarkably short chains” (Strogatz, 2003) Implications for, for instance, research on the spread of diseases... The general hint: -If networks start from relatively structured … -… and tend to progress sort of randomly … -- … then you might get small world networks a large part of the time TU/e - 0ZM05/0EM15/0A150 39 And now the third characteristic TU/e - 0ZM05/0EM15/0A150 40 If we consider all three… TU/e - 0ZM05/0EM15/0A150 41 … then we find this: TU/e - 0ZM05/0EM15/0A150 Wang & Chen (2003) Complex networks: Small-world, Scale-free and beyond 42 Same thing … we see “scale-freeness” all over TU/e - 0ZM05/0EM15/0A150 43 … and it can’t be based on an ER-network TU/e - 0ZM05/0EM15/0A150 44 TU/e - 0ZM05/0EM15/0A150 45 TU/e - 0ZM05/0EM15/0A150 46 Scale-free networks are: Robust to random problems/mistakes ... ... but vulnerable to selectively targeted attacks TU/e - 0ZM05/0EM15/0A150 47 Another BIG question: How do scale free networks arise? Potential answer: Perhaps through “preferential attachment” < show NetLogo simulation here> (Another) critique to this approach: it ignores ties created by those in the network TU/e - 0ZM05/0EM15/0A150 48 Some related issues TU/e - 0ZM05/0EM15/0A150 49 “The tipping point” (Watts*) Consider a network in which each node determines whether or not to adopt, based on what his direct connections do. Nodes have different thresholds to adopt (randomly distributed) Question: when do you get cascades of adoption? Answer: two phase transitions or tipping points: in sparse networks no cascades, as networks get more dense you get cascades suddenly as networks get more heterogenous, a sudden jump in the likelihood of cascades as networks get even more heterogenous, the likelihood of cascades decreases * Watts, D.J. (2002) A simple model of global cascades on random networks. Proceedings of the National Academy of Sciences USA 99, 5766-5771 TU/e - 0ZM05/0EM15/0A150 50 “Find the influentials” (or not?) TU/e - 0ZM05/0EM15/0A150 51 Malcolm Gladwell (journalist/writer: wrote “Blink” and “The tipping point” http://www.fastcompany.com/641124 /tipping-point-toast http://www.youtube.com/watch?v=AtnR5 H6AVVU Duncan Watts (scientist, Yahoo, Microsoft Research) TU/e - 0ZM05/0EM15/0A150 52 "All they'll ever say," Watts insists, is that a) there are people who are more influential than others, and b) they are disproportionately important in getting a trend going. That may be oversimplifying it a bit, but last year, Watts decided to put the whole idea to the test by building another Sims-like computer simulation. He programmed a group of 10,000 people, all governed by a few simple interpersonal rules. Each was able to communicate with anyone nearby. With every contact, each had a small probability of "infecting" another. And each person also paid attention to what was happening around him: If lots of other people were adopting a trend, he would be more likely to join, and vice versa. The "people" in the virtual society had varying amounts of sociability--some were more connected than others. Watts designated the top 10% most-connected as Influentials; they could affect four times as many people as the average Joe. In essence, it was a virtual society run--in a very crude fashion--according to the rules laid out by thinkers like Gladwell and Keller. Watts set the test in motion by randomly picking one person as a trendsetter, then sat back to see if the trend would spread. He did so thousands of times in a row. The results were deeply counterintuitive. The experiment did produce several hundred societywide infections. But in the large majority of cases, the cascade began with an average Joe (although in cases where an Influential touched off the trend, it spread much further). To stack the deck in favor of Influentials, Watts changed the simulation, making them 10 times more connected. Now they could infect 40 times more people than the average citizen (and again, when they kicked off a cascade, it was substantially larger). But the rank-and-file citizen was still far more likely to start a contagion. Why didn't the Influentials wield more power? With 40 times the reach of a normal person, why couldn't they kick-start a trend every time? Watts believes this is because a trend's success depends not on the person who starts it, but on how susceptible the society is overall to the trend--not how persuasive the early adopter is, but whether everyone else is easily persuaded. And in fact, when Watts tweaked his model to increase everyone's odds of being infected, the number of trends skyrocketed. "If society is ready to embrace a trend, almost anyone can start one--and if it isn't, then almost no one can," Watts concludes. To succeed with a new product, it's less a matter of finding the perfect hipster to infect and more a matter of gauging the public's mood. Sure, there'll always be a first mover in a trend. But since she generally stumbles into that role by chance, she is, in Watts's terminology, an "accidental Influential." TU/e - 0ZM05/0EM15/0A150 53 "All they'll ever say," Watts insists, is that a) there are people who are more influential than others, and b) they are disproportionately important in getting a trend going. That may be oversimplifying it a bit, but last year, Watts decided to put the whole idea to the test by building another Sims-like computer simulation. He programmed a group of 10,000 people, all governed by a few simple interpersonal rules. Each was able to communicate with anyone nearby. With every contact, each had a small probability of "infecting" another. And each person also paid attention to what was happening around him: If lots of other people were adopting a trend, he would be more likely to join, and vice versa. The "people" in the virtual society had varying amounts of sociability--some were more connected than others. Watts designated the top 10% most-connected as Influentials; they could affect four times as many people as the average Joe. In essence, it was a virtual society run--in a very crude fashion--according to the rules laid out by thinkers like Gladwell and Keller. Watts set the test in motion by randomly picking one person as a trendsetter, then sat back to see if the trend would spread. He did so thousands of times in a row. The results were deeply counterintuitive. The experiment did produce several hundred societywide infections. But in the large majority of cases, the cascade began with an average Joe (although in cases where an Influential touched off the trend, it spread much further). To stack the deck in favor of Influentials, Watts changed the simulation, making them 10 times more connected. Now they could infect 40 times more people than the average citizen (and again, when they kicked off a cascade, it was substantially larger). But the rank-and-file citizen was still far more likely to start a contagion. Why didn't the Influentials wield more power? With 40 times the reach of a normal person, why couldn't they kick-start a trend every time? Watts believes this is because a trend's success depends not on the person who starts it, but on how susceptible the society is overall to the trend--not how persuasive the early adopter is, but whether everyone else is easily persuaded. And in fact, when Watts tweaked his model to increase everyone's odds of being infected, the number of trends skyrocketed. "If society is ready to embrace a trend, almost anyone can start one--and if it isn't, then almost no one can," Watts concludes. To succeed with a new product, it's less a matter of finding the perfect hipster to infect and more a matter of gauging the public's mood. Sure, there'll always be a first mover in a trend. But since she generally stumbles into that role by chance, she is, in Watts's terminology, an "accidental Influential." TU/e - 0ZM05/0EM15/0A150 54 The bigger picture: Understanding macro patterns from micro behavior TU/e - 0ZM05/0EM15/0A150 56 The general approach … understand how STRUCTURE can arise from underlying MICRO-DYNAMICS Scientists are trying to connect the structural properties … Scale-free, small-world, locally clustered, bow-tie, hubs and authorities, communities, bipartite cores, network motifs, highly optimized tolerance, … … to processes (Erdos-Renyi) Random graphs, Exponential random graphs, Small-world model, Preferential attachment, Edge copying model, Community guided attachment, Forest fire models, Kronecker graphs, … TU/e - 0ZM05/0EM15/0A150 RECAP • Six degrees of separation: average path length is often small • Many real-world networks have properties that are similar: small-world and scale-free. • We do not really understand yet how these properties emerge. • We saw two clues: the Watts-Strogatz model for small-worlds and the preferential attachment model for scale-freeness. • Small-world and scale-free networks have some nice properties (which might explain why they exist) • Considerable controversy over what these kinds of results imply, for instance for marketing purposes • Hot scientific topic: connecting micro-behavior to macro-properties TU/e - 0ZM05/0EM15/0A150 58 To Do: Read and comprehend the papers on small world networks, scale-free networks (see website, there is extra material too). Think about implications and applications of these results TU/e - 0ZM05/0EM15/0A150 59