Scale-free network

Part of a series on
Network science
Theory
Graph Complex network Contagion Small-world Scale-free Community structure Percolation Evolution Controllability Graph drawing Social capital Link analysis Optimization Reciprocity Closure Homophily Transitivity Preferential attachment Balance theory Network effect Social influence
Network types
Informational (computing) Telecommunication Transport Social Scientific collaboration Biological Artificial neural Interdependent Semantic Spatial Dependency Flow on-Chip
Graphs
Features Clique Component Cut Cycle Data structure Edge Loop Neighborhood Path Vertex Adjacency list / matrix Incidence list / matrix Types Bipartite Complete Directed Hyper Labeled Multi Random Weighted
Metrics Algorithms
Centrality Degree Motif Clustering Degree distribution Assortativity Distance Modularity Efficiency
Models
Topology Random graph Erdős–Rényi Barabási–Albert Bianconi–Barabási Fitness model Watts–Strogatz Exponential random (ERGM) Random geometric (RGG) Hyperbolic (HGN) Hierarchical Stochastic block Blockmodeling Maximum entropy Soft configuration LFR Benchmark Dynamics Boolean network agent based SIR
Lists Categories
Topics Software Network scientists Category:Network theory Category:Graph theory
v t e

A scale-free network is a network whose degree distribution follows a power law, at least asymptotically. That is, the fraction P(k) of nodes in the network having k connections to other nodes goes for large values of k as

${\displaystyle P(k)\ \sim \ k^{\boldsymbol {-\gamma }}}$

where ${\displaystyle \gamma }$ is a parameter whose value is typically in the range ${\textstyle 2<\gamma <3}$ (wherein the second moment (scale parameter) of ${\displaystyle k^{\boldsymbol {-\gamma }}}$ is infinite but the first moment is finite), although occasionally it may lie outside these bounds.^[1][2] The name "scale-free" could be explained by the fact that some moments of the degree distribution are not defined, so that the network does not have a characteristic scale or "size".

Many networks have been reported to be scale-free, although statistical analysis has refuted many of these claims and seriously questioned others.^[3][4] Additionally, some have argued that simply knowing that a degree-distribution is fat-tailed is more important than knowing whether a network is scale-free according to statistically rigorous definitions.^[5][6] Preferential attachment and the fitness model have been proposed as mechanisms to explain conjectured power law degree distributions in real networks. Alternative models such as super-linear preferential attachment and second-neighbour preferential attachment may appear to generate transient scale-free networks, but the degree distribution deviates from a power law as networks become very large.^[7][8]

History

In studies of the networks of citations between scientific papers, Derek de Solla Price showed in 1965 that the number of links to papers—i.e., the number of citations they receive—had a heavy-tailed distribution following a Pareto distribution or power law, and thus that the citation network is scale-free. He did not however use the term "scale-free network", which was not coined until some decades later. In a later paper in 1976, Price also proposed a mechanism to explain the occurrence of power laws in citation networks, which he called "cumulative advantage" but which is today more commonly known under the name preferential attachment.

Recent interest in scale-free networks started in 1999 with work by Albert-László Barabási and Réka Albert at the University of Notre Dame who mapped the topology of a portion of the World Wide Web,^[9] finding that some nodes, which they called "hubs", had many more connections than others and that the network as a whole had a power-law distribution of the number of links connecting to a node. After finding that a few other networks, including some social and biological networks, also had heavy-tailed degree distributions, Barabási and Réka Albert coined the term "scale-free network" to describe the class of networks that exhibit a power-law degree distribution. However, studying seven examples of networks in social, economic, technological, biological, and physical systems, Amaral et al. were not able to find a scale-free network among these seven examples. Only one of these examples, the movie-actor network, had degree distribution P(k) following a power law regime for moderate k, though eventually this power law regime was followed by a sharp cutoff showing exponential decay for large k.^[10]

Barabási and

The history of scale-free networks also includes some disagreement. On an empirical level, the scale-free nature of several networks has been called into question. For instance, the three brothers Faloutsos believed that the

they interconnect. [14]

On a theoretical level, refinements to the abstract definition of scale-free have been proposed. For example, Li et al. (2005) offered a potentially more precise "scale-free metric". Briefly, let G be a graph with edge set E, and denote the degree of a vertex ${\displaystyle v}$ (that is, the number of edges incident to ${\displaystyle v}$) by ${\displaystyle \deg(v)}$. Define

${\displaystyle s(G)=\sum _{(u,v)\in E}\deg(u)\cdot \deg(v).}$

This is maximized when high-degree nodes are connected to other high-degree nodes. Now define

${\displaystyle S(G)={\frac {s(G)}{s_{\max }}},}$

where s_max is the maximum value of s(H) for H in the set of all graphs with degree distribution identical to that of G. This gives a metric between 0 and 1, where a graph G with small S(G) is "scale-rich", and a graph G with S(G) close to 1 is "scale-free". This definition captures the notion of self-similarity implied in the name "scale-free".

Overview

When the concept of "scale-free" was initially introduced in the context of networks,^[9] it primarily referred to a specific trait: a power-law distribution for a given variable ${\displaystyle k}$, expressed as ${\displaystyle f(k)\propto k^{-\gamma }}$. This property maintains its form when subjected to a continuous scale transformation ${\displaystyle k\to k+\epsilon k}$, evoking parallels with the renormalization group techniques in statistical field theory.^[15][16]

However, there's a key difference. In statistical field theory, the term "scale" often pertains to system size. In the realm of networks, "scale" ${\displaystyle k}$ is a measure of connectivity, generally quantified by a node's degree—that is, the number of links attached to it. Networks featuring a higher number of high-degree nodes are deemed to have greater connectivity.

The power-law degree distribution enables us to make "scale-free" assertions about the prevalence of high-degree nodes.^[17] For instance, we can say that "nodes with triple the average connectivity occur half as frequently as nodes with average connectivity." The specific numerical value of what constitutes "average connectivity" becomes irrelevant, whether it's a hundred or a million.^[18]

Characteristics

The most notable characteristic in a scale-free network is the relative commonness of vertices with a degree that greatly exceeds the average. The highest-degree nodes are often called "hubs", and are thought to serve specific purposes in their networks, although this depends greatly on the domain.

Clustering

Another important characteristic of scale-free networks is the

.

At present, the more specific characteristics of scale-free networks vary with the generative mechanism used to create them. For instance, networks generated by preferential attachment typically place the high-degree vertices in the middle of the network, connecting them together to form a core, with progressively lower-degree nodes making up the regions between the core and the periphery. The random removal of even a large fraction of vertices impacts the overall connectedness of the network very little, suggesting that such topologies could be useful for security, while targeted attacks destroys the connectedness very quickly. Other scale-free networks, which place the high-degree vertices at the periphery, do not exhibit these properties. Similarly, the clustering coefficient of scale-free networks can vary significantly depending on other topological details.

Immunization

The question of how to immunize efficiently scale free networks which represent realistic networks such as the Internet and social networks has been studied extensively. One such strategy is to immunize the largest degree nodes, i.e., targeted (intentional) attacks since for this case p${\displaystyle c}$ is relatively high and less nodes are needed to be immunized. However, in many realistic cases the global structure is not available and the largest degree nodes are not known.

Properties of random graph may change or remain invariant under graph transformations. Mashaghi A. et al., for example, demonstrated that a transformation which converts random graphs to their edge-dual graphs (or line graphs) produces an ensemble of graphs with nearly the same degree distribution, but with degree correlations and a significantly higher clustering coefficient. Scale free graphs, as such, remain scale free under such transformations.^[19]

Examples

Although many real-world networks are thought to be scale-free, the evidence often remains inconclusive, primarily due to the developing awareness of more rigorous data analysis techniques.^[3] As such, the scale-free nature of many networks is still being debated by the scientific community. A few examples of networks claimed to be scale-free include:

• Some Social networks, including collaboration networks. Two examples that have been studied extensively are the collaboration of movie actors in films and the co-authorship by mathematicians of papers.
• Many kinds of computer networks, including the internet and the webgraph of the World Wide Web.
• Some financial networks such as interbank payment networks ^[20][21]
• Protein–protein interaction networks.
• Semantic networks.^[22]
• Airline networks.

Scale free topology has been also found in high temperature superconductors.^[23] The qualities of a high-temperature superconductor — a compound in which electrons obey the laws of quantum physics, and flow in perfect synchrony, without friction — appear linked to the fractal arrangements of seemingly random oxygen atoms and lattice distortion.^[24]

A space-filling cellular structure,

has recently been proposed whose coordination number distribution follow a power-law. It implies that the lattice has a few blocks which have astonishingly large number neighbors with whom they share common borders. Its construction starts with an initiator, say a square of unit area, and a generator that divides it randomly into four blocks. The generator thereafter is sequentially applied over and over again to only one of the available blocks picked preferentially with respect to their areas. It results in the partitioning of the square into ever smaller mutually exclusive rectangular blocks. The dual of the WPSL (DWPSL), which is obtained by replacing each block with a node at its center, and each common border between blocks with an edge joining the two corresponding vertices, emerges as a network whose degree distribution follows a power-law.^[25][26] The reason for it is that it grows following mediation-driven attachment model rule which also embodies preferential attachment rule but in disguise.

Generative models

Scale-free networks do not arise by chance alone. Erdős and Rényi (1960) studied a model of growth for graphs in which, at each step, two nodes are chosen uniformly at random and a link is inserted between them. The properties of these random graphs are different from the properties found in scale-free networks, and therefore a model for this growth process is needed.

The most widely known generative model for a subset of scale-free networks is Barabási and Albert's (1999)

generative model in which each new Web page creates links to existing Web pages with a probability distribution which is not uniform, but proportional to the current in-degree of Web pages. This model was originally invented by

A somewhat different generative model for Web links has been suggested by Pennock et al. (2002). They examined communities with interests in a specific topic such as the home pages of universities, public companies, newspapers or scientists, and discarded the major hubs of the Web. In this case, the distribution of links was no longer a power law but resembled a normal distribution. Based on these observations, the authors proposed a generative model that mixes preferential attachment with a baseline probability of gaining a link.

Another generative model is the copy model studied by Kumar et al.^[28] (2000), in which new nodes choose an existent node at random and copy a fraction of the links of the existent node. This also generates a power law.

There are two major components that explain the emergence of the power-law distribution in the Barabási–Albert model: the growth and the preferential attachment.^[29] By "growth" is meant a growth process where, over an extended period of time, new nodes join an already existing system, a network (like the World Wide Web which has grown by billions of web pages over 10 years). Finally, by "preferential attachment" is meant that new nodes prefer to connect to nodes that already have a high number of links with others. Thus, there is a higher probability that more and more nodes will link themselves to that one which has already many links, leading this node to a hub in-fine.^[9] Depending on the network, the hubs might either be assortative or disassortative. Assortativity would be found in social networks in which well-connected/famous people would tend to know better each other. Disassortativity would be found in technological (Internet, World Wide Web) and biological (protein interaction, metabolism) networks.^[29]

However, the growth of the networks (adding new nodes) is not a necessary condition for creating a scale-free network (see Dangalchev^[30]). One possibility (Caldarelli et al. 2002) is to consider the structure as static and draw a link between vertices according to a particular property of the two vertices involved. Once specified the statistical distribution for these vertex properties (fitnesses), it turns out that in some circumstances also static networks develop scale-free properties.

Generalized scale-free model

There has been a burst of activity in the modeling of

In today's terms, if a complex network has a power-law distribution of any of its metrics, it's generally considered a scale-free network. Similarly, any model with this feature is called a scale-free model.[17]

Features

Many real networks are (approximately) scale-free and hence require scale-free models to describe them. In Price's scheme, there are two ingredients needed to build up a scale-free model:

1. Adding or removing nodes. Usually we concentrate on growing the network, i.e. adding nodes.

2. Preferential attachment: The probability ${\displaystyle \Pi }$ that new nodes will be connected to the "old" node.

Note that some models (see Dangalchev^[30] and Fitness model below) can work also statically, without changing the number of nodes. It should also be kept in mind that the fact that "preferential attachment" models give rise to scale-free networks does not prove that this is the mechanism underlying the evolution of real-world scale-free networks, as there might exist different mechanisms at work in real-world systems that nevertheless give rise to scaling.

Examples

There have been several attempts to generate scale-free network properties. Here are some examples:

The Barabási–Albert model

The Barabási–Albert model, an undirected version of Price's model has a linear preferential attachment ${\displaystyle \Pi (k_{i})={\frac {k_{i}}{\sum _{j}k_{j}}}}$ and adds one new node at every time step.

(Note, another general feature of ${\displaystyle \Pi (k)}$ in real networks is that ${\displaystyle \Pi (0)\neq 0}$, i.e. there is a nonzero probability that a new node attaches to an isolated node. Thus in general ${\displaystyle \Pi (k)}$ has the form ${\displaystyle \Pi (k)=A+k^{\alpha }}$, where ${\displaystyle A}$ is the initial attractiveness of the node.)

Two-level network model

Dangalchev (see ^[30]) builds a 2-L model by considering the importance of each of the neighbours of a target node in preferential attachment. The attractiveness of a node in the 2-L model depends not only on the number of nodes linked to it but also on the number of links in each of these nodes.

${\displaystyle \Pi (k_{i})={\frac {k_{i}+C\sum _{(i,j)}k_{j}}{\sum _{j}k_{j}+C\sum _{j}k_{j}^{2}}},}$

where C is a coefficient between 0 and 1.

A variant of the 2-L model, the k2 model, where first and second neighbour nodes contribute equally to a target node's attractiveness, demonstrates the emergence of transient scale-free networks.^[8] In the k2 model, the degree distribution appears approximately scale-free as long as the network is relatively small, but significant deviations from the scale-free regime emerge as the network grows larger. This results in the relative attractiveness of nodes with different degrees changing over time, a feature also observed in real networks.

Mediation-driven attachment (MDA) model

In the mediation-driven attachment (MDA) model, a new node coming with ${\displaystyle m}$ edges picks an existing connected node at random and then connects itself, not with that one, but with ${\displaystyle m}$ of its neighbors, also chosen at random. The probability ${\displaystyle \Pi (i)}$ that the node ${\displaystyle i}$ of the existing node picked is

${\displaystyle \Pi (i)={\frac {k_{i}}{N}}{\frac {\sum _{j=1}^{k_{i}}{\frac {1}{k_{j}}}}{k_{i}}}.}$

The factor ${\displaystyle {\frac {\sum _{j=1}^{k_{i}}{\frac {1}{k_{j}}}}{k_{i}}}}$ is the inverse of the harmonic mean (IHM) of degrees of the ${\displaystyle k_{i}}$ neighbors of a node ${\displaystyle i}$. Extensive numerical investigation suggest that for approximately ${\displaystyle m>14}$ the mean IHM value in the large ${\displaystyle N}$ limit becomes a constant which means ${\displaystyle \Pi (i)\propto k_{i}}$. It implies that the higher the links (degree) a node has, the higher its chance of gaining more links since they can be reached in a larger number of ways through mediators which essentially embodies the intuitive idea of rich get richer mechanism (or the preferential attachment rule of the Barabasi–Albert model). Therefore, the MDA network can be seen to follow the PA rule but in disguise.^[37]

However, for ${\displaystyle m=1}$ it describes the winner takes it all mechanism as we find that almost ${\displaystyle 99\%}$ of the total nodes has degree one and one is super-rich in degree. As ${\displaystyle m}$ value increases the disparity between the super rich and poor decreases and as ${\displaystyle m>14}$ we find a transition from rich get super richer to rich get richer mechanism.

Non-linear preferential attachment

The Barabási–Albert model assumes that the probability ${\displaystyle \Pi (k)}$ that a node attaches to node ${\displaystyle i}$ is proportional to the degree ${\displaystyle k}$ of node ${\displaystyle i}$. This assumption involves two hypotheses: first, that ${\displaystyle \Pi (k)}$ depends on ${\displaystyle k}$, in contrast to random graphs in which ${\displaystyle \Pi (k)=p}$, and second, that the functional form of ${\displaystyle \Pi (k)}$ is linear in ${\displaystyle k}$.

In non-linear preferential attachment, the form of ${\displaystyle \Pi (k)}$ is not linear, and recent studies have demonstrated that the degree distribution depends strongly on the shape of the function ${\displaystyle \Pi (k)}$

Krapivsky, Redner, and Leyvraz

linear, i.e. ${\displaystyle \Pi (k_{i})\sim a_{\infty }k_{i}}$ as ${\displaystyle k_{i}\to \infty }$. In this case the rate equation leads to

${\displaystyle P(k)\sim k^{-\gamma }{\text{ with }}\gamma =1+{\frac {\mu }{a_{\infty }}}.}$

This way the exponent of the degree distribution can be tuned to any value between 2 and ${\displaystyle \infty }$.^{[clarification needed]}

Hierarchical network model

Hierarchical network models are, by design, scale free and have high clustering of nodes.^[38]

The

construction leads to a hierarchical network. Starting from a fully connected cluster of five nodes, we create four identical replicas connecting the peripheral nodes of each cluster to the central node of the original cluster. From this, we get a network of 25 nodes (N = 25). Repeating the same process, we can create four more replicas of the original cluster – the four peripheral nodes of each one connect to the central node of the nodes created in the first step. This gives N = 125, and the process can continue indefinitely.

Fitness model

The idea is that the link between two vertices is assigned not randomly with a probability p equal for all the couple of vertices. Rather, for every vertex j there is an intrinsic fitness x_j and a link between vertex i and j is created with a probability ${\displaystyle p(x_{i},x_{j})}$.^[39] In the case of World Trade Web it is possible to reconstruct all the properties by using as fitnesses of the country their GDP, and taking

${\displaystyle p(x_{i},x_{j})={\frac {\delta x_{i}x_{j}}{1+\delta x_{i}x_{j}}}.}$^[40]

Hyperbolic geometric graphs

Assuming that a network has an underlying hyperbolic geometry, one can use the framework of spatial networks to generate scale-free degree distributions. This heterogeneous degree distribution then simply reflects the negative curvature and metric properties of the underlying hyperbolic geometry.^[41]

Edge dual transformation to generate scale free graphs with desired properties

Starting with scale free graphs with low degree correlation and clustering coefficient, one can generate new graphs with much higher degree correlations and clustering coefficients by applying edge-dual transformation.^[19]

Uniform-preferential-attachment model (UPA model)

UPA model is a variant of the preferential attachment model (proposed by Pachon et al.) which takes into account two different attachment rules: a preferential attachment mechanism (with probability 1−p) that stresses the rich get richer system, and a uniform choice (with probability p) for the most recent nodes. This modification is interesting to study the robustness of the scale-free behavior of the degree distribution. It is proved analytically that the asymptotically power-law degree distribution is preserved.^[27]

Scale-free ideal networks

In the context of

'.

Novel characteristics

For a scale-free network with ${\displaystyle n}$ nodes and power-law exponent ${\displaystyle \gamma >3}$, the induced subgraph constructed by vertices with degrees larger than ${\displaystyle \log {n}\times \log ^{*}{n}}$ is a scale-free network with ${\displaystyle \gamma '=2}$, almost surely.^[44]

Estimating the power law exponent

Estimating the power-law exponent ${\displaystyle \gamma }$ of a scale-free network is typically done by using the maximum likelihood estimation with the degrees of a few uniformly sampled nodes.^[3] However, since uniform sampling does not obtain enough samples from the important heavy-tail of the power law degree distribution, this method can yield a large bias and a variance. It has been recently proposed to sample random friends (i.e., random ends of random links) who are more likely come from the tail of the degree distribution as a result of the friendship paradox.^[45][46] Theoretically, maximum likelihood estimation with random friends lead to a smaller bias and a smaller variance compared to classical approach based on uniform sampling.^[46]

See also

• Random graph – Graph generated by a random process
• Erdős–Rényi model – Two closely related models for generating random graphs
• Non-linear preferential attachment
• Bose–Einstein condensation (network theory)
   – model in network sciencePages displaying wikidata descriptions as a fallback
• Scale invariance – Features that do not change if length or energy scales are multiplied by a common factor
• Complex network – Network with non-trivial topological features
• Webgraph – Graph of connected web pages
• Barabási–Albert model – Scale-free network generation algorithm
• Bianconi–Barabási model – model in network sciencePages displaying wikidata descriptions as a fallback

References

Further reading

• Albert R.; Barabási A.-L. (2002). "Statistical mechanics of complex networks". Rev. Mod. Phys. 74 (1): 47–97.
  S2CID 60545
  .
• Amaral LAN, Scala A, Barthelemy M, Stanley HE (2000). "Classes of small-world networks". PNAS. 97 (21): 11149–52.
  PMID 11005838
  .
• Barabási, Albert-László (2004). Linked: How Everything is Connected to Everything Else. Perseus Pub.
  ISBN 0-452-28439-2
  .
• Barabási, Albert-László; Bonabeau, Eric (May 2003). "Scale-Free Networks" (PDF). Scientific American. 288 (5): 50–9.
  PMID 12701331
  .
• Dan Braha; Yaneer Bar-Yam (2004). "Topology of Large-Scale Engineering Problem-Solving Networks" (PDF). Phys. Rev. E. 69 (1): 016113.
  S2CID 1001176
  .
• Caldarelli G. "Scale-Free Networks" Oxford University Press, Oxford (2007).
• Caldarelli G.; Capocci A.; De Los Rios P.; Muñoz M.A. (2002). "Scale-free networks from varying vertex intrinsic fitness". Physical Review Letters. 89 (25): 258702.
  PMID 12484927
  .
• Dangalchev, Ch. (2004). "Generation models for scale-free networks". Physica A. 338 (3–4): 659–671.
  doi:10.1016/j.physa.2004.01.056
  .
• Dorogovtsev, S.N.; Mendes, J.F.F.; Samukhin, A.N. (2000). "Structure of Growing Networks: Exact Solution of the Barabási—Albert's Model". Phys. Rev. Lett. 85 (21): 4633–6.
  S2CID 118876189
  .
• Dorogovtsev, S.N.; Mendes, J.F.F. (2003). Evolution of Networks: from biological networks to the Internet and WWW. Oxford University Press.
  ISBN 0-19-851590-1
  .
• Dorogovtsev, S.N.; Goltsev A.V.; Mendes, J.F.F. (2008). "Critical phenomena in complex networks". Rev. Mod. Phys. 80 (4): 1275–1335.
  S2CID 3174463
  .
• Dorogovtsev, S.N.; Mendes, J.F.F. (2002). "Evolution of networks". Advances in Physics. 51 (4): 1079–1187.
  S2CID 429546
  .
• Erdős, P.; Rényi, A. (1960). On the Evolution of Random Graphs (PDF). Vol. 5. Publication of the Mathematical Institute of the Hungarian Academy of Science. pp. 17–61.
• Faloutsos, M.; Faloutsos, P.; Faloutsos, C. (1999). "On power-law relationships of the internet topology". Comp. Comm. Rev. 29 (4): 251–262.
  doi:10.1145/316194.316229
  .
• Li, L.; Alderson, D.; Tanaka, R.; Doyle, J.C.; Willinger, W. (2005). "Towards a Theory of Scale-Free Graphs: Definition, Properties, and Implications (Extended Version)".
  arXiv:cond-mat/0501169
  .
• Kumar, R.; Raghavan, P.; Rajagopalan, S.; Sivakumar, D.; Tomkins, A.; Upfal, E. (2000). "Stochastic models for the web graph" (PDF). Proceedings of the 41st Annual Symposium on Foundations of Computer Science (FOCS). Redondo Beach, CA: IEEE CS Press. pp. 57–65.
• Matlis, Jan (November 4, 2002). "Scale-Free Networks".
• Newman, Mark E.J. (2003). "The structure and function of complex networks". SIAM Review. 45 (2): 167–256.
  S2CID 221278130
  .
• Pastor-Satorras, R.; Vespignani, A. (2004). Evolution and Structure of the Internet: A Statistical Physics Approach. Cambridge University Press.
  ISBN 0-521-82698-5
  .
• Pennock, D.M.; Flake, G.W.; Lawrence, S.; Glover, E.J.; Giles, C.L. (2002). "Winners don't take all: Characterizing the competition for links on the web". PNAS. 99 (8): 5207–11.
  PMID 16578867
  .
• Robb, John. Scale-Free Networks and Terrorism, 2004.
• Keller, E.F. (2005). "Revisiting "scale-free" networks". BioEssays. 27 (10): 1060–8.
  PMID 16163729. Archived from the original
  on 2011-08-13.
• Onody, R.N.; de Castro, P.A. (2004). "Complex Network Study of Brazilian Soccer Player". Phys. Rev. E. 70 (3): 037103.
  S2CID 31653489
  .
• Kasthurirathna, D.; Piraveenan, M. (2015). "Complex Network Study of Brazilian Soccer Player". Sci. Rep. In Press.