Source-linked AI summary
Community structure in social and biological networks
Michelle Girvan, M. E. J. Newman
TL;DR
The paper asks how community structure—dense groups with looser intergroup connections—can be detected in networks alongside other common network properties. It proposes an edge-betweenness method that removes likely boundary edges, and reports accurate recovery of known communities plus informative divisions in collaboration and food-web networks.
Problem
Many networks appear to contain densely connected communities linked by fewer edges, but detecting these divisions is a distinct problem from other common network properties.
Source: §I · p. 1Method
The paper detects communities by progressively removing edges with high edge betweenness, recalculating affected betweennesses after each removal.
Source: B. Edge betweenness and community… · p. 3Results
The method detects known community structure with high sensitivity and reliability in computer-generated and real-world graphs, and finds significant divisions in collaboration and food-web networks.
Source: §I · p. 2, A. Computer-generated graphs · p. 3, B. Zachary’s karate club study · p. 4Takeaways & Limitations
The method provides community divisions that agree closely with known structures and may help interpret the relationship between network structure and function.
Source: §I · p. 2, B. Zachary’s karate club study · p. 4
Abstract
from arXiv · showhide
A number of recent studies have focused on the statistical properties of networked systems such as social networks and the World-Wide Web. Researchers have concentrated particularly on a few properties which seem to be common to many networks: the small-world property, power-law degree distributions, and network transitivity. In this paper, we highlight another property which is found in many networks, the property of community structure, in which network nodes are joined together in tightly-knit groups between which there are only looser connections. We propose a new method for detecting such communities, built around the idea of using centrality indices to find community boundaries. We test our method on computer generated and real-world graphs whose community structure is already known, and find that it detects this known structure with high sensitivity and reliability. We also apply the method to two networks whose community structure is not well-known - a collaboration network and a food web - and find that it detects significant and informative community divisions in both cases.
I. INTRODUCTION
Networks share statistical properties such as short path lengths, skewed degree distributions, and transitivity, but this paper focuses on community structure: dense groups linked by fewer edges.
I. INTRODUCTION
- Networks include social, technological, and biological systems, with common properties including short average distances and right-skewed degree distributions.The average distance often scales logarithmically with the number of vertices, while degree distributions may follow power-law or exponential forms.Source: §I · p. 1
- The paper distinguishes community structure from network transitivity, which measures whether two neighbors of a vertex are themselves connected.The clustering coefficient quantifies this transitivity and typically ranges from 0.1 to 0.5 in many real-world networks.Source: §I · p. 1
- Community structure consists of densely connected vertex groups with relatively few connections between groups.The paper illustrates this organization with three communities and notes that communities may themselves form hierarchical meta-communities.Source: §I · p. 1, Figure 1 · p. 1
- Detecting communities could identify social groupings, related papers, functional metabolic groupings, or Web pages on related topics.Such divisions may help researchers understand and use networked systems more effectively.Source: §I · p. 2
- The paper proposes a new community-detection method and applies it to social and biological networks.It reports strong agreement with known communities and promising divisions in networks whose structure is not established.Source: §I · p. 2
II. DETECTING COMMUNITY STRUCTURE
The paper reviews existing community-detection methods, considers how they can fail, and introduces an approach intended to avoid some of their shortcomings.
II. DETECTING COMMUNITY STRUCTURE
- Existing community-detection methods are reviewed alongside their potential failure modes before the paper’s method is introduced.The stated purpose is to motivate an approach that avoids some shortcomings of traditional techniques.Source: §II · p. 2
A. Traditional methods
Traditional hierarchical clustering assigns weights to vertex pairs, progressively joins strongly weighted pairs, and represents nested communities as a dendrogram, but path-based weights can isolate peripheral vertices.
A. Traditional methods
- Hierarchical clustering adds vertex-pair edges from strongest to weakest weights, producing nested components represented by a dendrogram.A tree slice at a chosen level gives the communities present before the next edge is added.Source: A. Traditional methods · p. 2, Figure 2 · p. 2
- Node-independent path counts measure robustness by equaling the minimum number of vertices whose removal disconnects two vertices.This is one proposed weight for hierarchical clustering.Source: A. Traditional methods · p. 2
- Weighted path counts discount paths of length ℓ by α^ℓ, with α below the reciprocal of the largest adjacency-matrix eigenvalue so the sum converges.The resulting weights are given by elements of [I − αA]^-1.Source: A. Traditional methods · p. 2
- Both path-based weighting schemes can isolate peripheral vertices that connect to the rest of a network through only one edge.Their low path counts can leave such vertices outside the communities they should join, and other pathologies make hierarchical clustering imperfect.Source: A. Traditional methods · pp. 2–3
B. Edge betweenness and community structure
The proposed method detects community boundaries by repeatedly removing high-edge-betweenness links, because shortest paths between loosely connected groups concentrate on those links.
B. Edge betweenness and community structure
- The method reverses traditional clustering: it progressively removes inter-community edges instead of adding strongest edges to an initially empty graph.This design targets community peripheries rather than strongly connected cores.Source: B. Edge betweenness and community… · p. 3
- Edges connecting loosely linked communities have high edge betweenness because shortest paths between groups pass through them.Removing these edges separates groups and reveals the graph’s community structure.Source: B. Edge betweenness and community… · p. 3
- The algorithm calculates edge betweenness, removes the highest-betweenness edge, recalculates affected values, and repeats until no edges remain.The implementation uses Newman’s fast betweenness algorithm, with worst-case running time O(m^2n).Source: B. Edge betweenness and community… · p. 3
- For networks with strong community structure, runtime may improve because removals can rapidly split the graph into separate components.Only edges affected by the removal need recalculation, potentially reducing work below the worst-case bound.Source: B. Edge betweenness and community… · p. 3
- Recomputing betweenness after each removal is necessary because removing one edge can change which remaining inter-community edge has high betweenness.Calculating all betweennesses only once performs poorly when communities have multiple connecting edges.Source: B. Edge betweenness and community… · p. 3
III. TESTS OF THE METHOD
The algorithm is tested on computer-generated and real-world networks whose community structure is already known, and reliably detects that known structure.
- The tests evaluate the algorithm on artificial graphs and real-world networks with established community structure.Source: §III · p. 3
A. Computer-generated graphs
On controlled graphs with four planted communities, the algorithm remains highly accurate until inter-community connectivity approaches intra-community connectivity.
A. Computer-generated graphs
- Nearly 100% of vertices are classified correctly when each vertex has at most 6 inter-community edges.Accuracy begins to decline only when zout > 6, near the point where inter-community and intra-community connections are balanced.Source: A. Computer-generated graphs · pp. 3–4, Figure 3 · p. 4
B. Zachary’s karate club study
Applied to Zachary’s karate-club friendship network, the method recovers the observed faction split almost exactly, misclassifying only node 3.
B. Zachary’s karate club study
- The network captures a disagreement between the club administrator and instructor that led to the instructor’s departure with about half the members.Source: B. Zachary’s karate club study · p. 4
- The first hierarchical split divides the 34-member network into two groups that nearly match the factions formed after the club’s breakup.The figure reports that node 3 is the sole misclassification.Source: B. Zachary’s karate club study · p. 4, Figure 4 · p. 4
C. College football
In the 2000 US college-football schedule, the algorithm largely recovers conference communities, while errors occur where scheduling patterns do not align with conference membership.
C. College football
- Almost all teams are grouped with their actual conferences, demonstrating high success on the college-football network.Source: C. College football · pp. 4–5
- The method groups independent teams with their closest conferences and can split or misgroup conferences when cross-conference games are nearly as frequent as intra-conference games.The Sunbelt is split and grouped with the Western Athletic conference because its teams played nearly as many games against that conference as within their own.Source: C. College football · p. 5
IV. APPLICATIONS
The method was applied to previously uncharacterized collaboration and food-web networks, producing interpretable community divisions. In the Santa Fe collaboration network, detected groups aligned with disciplines, research topics, and methodologies.
IV. APPLICATIONS
- The applications section evaluates the method on a collaboration network and a Chesapeake Bay food web whose community structures were not previously well known.These applications aim to clarify the organization of otherwise complex datasets.Source: §IV · p. 5
A. Collaboration network
- The Santa Fe collaboration network contains 271 scientists, with edges linking pairs who coauthored one or more articles during 1999 or 2000.Source: A. Collaboration network · p. 5
- Detected collaboration communities primarily followed disciplinary lines, with nested groups associated with economics and traffic, ecology, statistical physics, and RNA research.The statistical-physics and RNA communities were further divided into smaller groups centered on leading members.Source: A. Collaboration network · p. 6
- The algorithm identified communities organized by research topic or methodology, with methodological similarity linking researchers from traditionally disparate fields.The authors conjecture that this pattern may be peculiar to interdisciplinary centers such as the Santa Fe Institute.Source: A. Collaboration network · p. 6
B. Food web
In the Chesapeake Bay food web, the method found two substantial communities and a few unassigned taxa. Their division closely matched pelagic versus benthic habitat rather than trophic level, although the separation was imperfect.
B. Food web
- The Chesapeake Bay food web contains 33 taxa linked by trophic relationships, treated as an undirected network for analysis.Most vertices represent species or genera, while some represent groups of related species.Source: B. Food web · p. 6
- The algorithm found two well-defined communities of roughly equal size plus a small number of vertices belonging to neither community.The two major groups corresponded closely to pelagic and benthic organisms.Source: B. Food web · p. 6
- The detected groups included organisms from multiple trophic levels, contrasting with methods that tend to cluster food-web taxa by trophic level.The result suggests pelagic and benthic organisms form reasonably self-contained ecological subsystems.Source: B. Food web · p. 7
- A small number of benthic organisms entered the pelagic community, suggesting that habitat-based classification is not perfectly separated in this ecosystem.These taxa may play substantial roles in food chains involving surface-dwelling organisms.Source: B. Food web · p. 7
- The method may perform less well on dense food webs because it was designed with sparse networks in mind.Other food webs lacked clear community structure, which may reflect either genuine ecological organization or the algorithm’s density limitation.Source: B. Food web · p. 7
V. CONCLUSIONS
The paper introduces a community-detection method based on edge betweenness and community peripheries. It succeeds on known artificial and real-world structures, supporting its use across varied networks.
V. CONCLUSIONS
- The paper introduces a method that detects community peripheries using edge-betweenness information rather than seeking strongly connected community cores.This approach is presented as distinct from previous methods focused on community cores.Source: §V · p. 7
- Tests on computer-generated graphs show that the method detects known community structure with a high degree of success.Source: §V · p. 7
- Applications to two real-world networks further demonstrate the method’s use for investigating community structure in networks of different kinds.Source: §V · p. 7
Related papers
Cited by
- Every route counts, but some count more: a max-plus view of the C. elegans brain2026
- HDLouvain: High-Throughput Incremental Clustering for Hyperdimensional Data2026
- Tracking and Predicting Evolution of Social Communities2026
- Language-encoded network topology enables large language models to reason about complex networks2026
- Kernelization of 2-Club Cluster Edge Deletion on Interval Graphs2026
- Comparison of Algebraic Block Multi-Coloring and Leiden Methods for Parallel Preconditioning in the ICCG Method2026