Source-linked AI summary

Community Detection via Semi-Synchronous Label Propagation Algorithms

Gennaro Cordasco, Luisa Gargano

arXiv:1103.4550v1cs.SIphysics.soc-ph

TL;DR

Community detection requires methods that balance accurate partitions with computational efficiency, while existing label-propagation schedules can oscillate or perform poorly. The paper proposes a semi-synchronous LPA for arbitrary graphs, proves convergence, and finds comparable quality, efficient parallelization, and greater stability than asynchronous propagation.

  • Problem

    Community detection methods must balance accurate network partitioning with low computational complexity, while synchronous and asynchronous label propagation each have drawbacks.

  • Method

    The paper proposes a semi-synchronous label propagation algorithm for arbitrary graphs and formally analyzes its convergence while limiting randomization.

  • Results

    The semi-synchronous approach preserves partitioning accuracy, is easily parallelizable, and is more stable than asynchronous propagation.

  • Takeaways & Limitations

    Semi-synchronous label propagation combines comparable quality with parallel efficiency and stable termination through a simple stopping criterion.

Abstract

from arXiv · show

A recently introduced novel community detection strategy is based on a label propagation algorithm (LPA) which uses the diffusion of information in the network to identify communities. Studies of LPAs showed that the strategy is effective in finding a good community structure. Label propagation step can be performed in parallel on all nodes (synchronous model) or sequentially (asynchronous model); both models present some drawback, e.g., algorithm termination is nor granted in the first case, performances can be worst in the second case. In this paper, we present a semi-synchronous version of LPA which aims to combine the advantages of both synchronous and asynchronous models. We prove that our models always converge to a stable labeling. Moreover, we experimentally investigate the effectiveness of the proposed strategy comparing its performance with the asynchronous model both in terms of quality, efficiency and stability. Tests show that the proposed protocol does not harm the quality of the partitioning. Moreover it is quite efficient; each propagation step is extremely parallelizable and it is more stable than the asynchronous model, thanks to the fact that only a small amount of randomization is used by our proposal.

I. INTRODUCTION

Community detection seeks network partitions whose nodes are internally similar and comparatively distinct, enabling insight into modeled systems. The paper extends label propagation to a semi-synchronous algorithm for arbitrary graphs, addressing convergence and scalability concerns.

  • Community detection partitions complex networks into groups of similar nodes, helping reveal the organization and behavior of the modeled system.
  • Label propagation identifies communities by diffusing labels through network structure, assigning each node the most frequent label among its neighbors.
  • Synchronous propagation can oscillate without termination, whereas asynchronous propagation updates one node at a time and costs O(m) per iteration.
  • The paper extends semi-synchronous label propagation from bipartite networks to arbitrary graphs and formally proves convergence without requiring randomization for good performance.
  • A good strategy must balance accurate partitioning with low computational complexity, with modularity used as a quality measure against a degree-preserving null model.

III. RELATED WORK

Community detection methods generally seek densely connected groups with sparse connections between groups. Existing approaches include divisive, agglomerative, optimization, and label-propagation strategies.

  • Communities are generally defined as node subsets that are densely interconnected relative to the rest of the network.
  • Existing community detection algorithms are commonly classified as divisive, agglomerative, or optimization approaches.
  • Label propagation differs from these approaches by using an epidemic-style diffusion of information to identify network partitions.

B. Label propagation algorithms

LPA detects communities by propagating prevalent neighbor labels, but synchronous and asynchronous updates have complementary weaknesses. Synchronous updates are highly parallelizable yet may oscillate, while asynchronous updates reduce oscillations at the cost of parallelism, stability, and sometimes partition quality.

  • B. Label propagation algorithms: LPA assigns each vertex a label and iteratively replaces it with the most frequent neighboring label, yielding communities as connected groups sharing a final label.Ties are resolved randomly, and the process stops under a specified criterion.
  • B. Label propagation algorithms: Synchronous LPA updates all vertices from the previous step, making each propagation step embarrassingly parallelizable.The algorithm is easy to implement because labels within a step have no dependencies.
  • B. Label propagation algorithms: Synchronous updating can produce cyclic label oscillations, including on non-bipartite and non-star-like graphs, so termination is not guaranteed.The paper notes that oscillations occur beyond the commonly cited bipartite or star components.
  • B. Label propagation algorithms: Asynchronous LPA reduces oscillations but introduces sequential dependencies that hinder parallelization and make parallel runtime grow more than linearly with network size.By contrast, the cited parallelized synchronous version scales logarithmically.
  • B. Label propagation algorithms: Random update orders make asynchronous LPA unstable across runs and can produce one oversized “monster” community alongside several small communities.These effects arise in addition to the algorithm’s reduced parallelism.

D. LPA for bipartite networks

The bipartite-network LPA updates the two vertex partitions in synchronized stages. This design retains effectiveness while enabling parallel updates within each partition and avoiding observed label oscillations.

  • D. LPA for bipartite networks: The bipartite LPA divides each propagation step into two synchronized stages, updating one partition and then the other.Blue and red vertices form the two canonical partitions.
  • D. LPA for bipartite networks: Experiments reported for the bipartite variant found it as effective as standard LPA, easily parallelizable, and stable, with no observed label oscillations.The stability claim is empirical in the cited passage.
  • D. LPA for bipartite networks: Within each bipartite partition, label propagation for distinct vertices is independent, so both stages are parallelizable.The method corresponds to an asynchronous ordering in which all blue vertices precede all red vertices.

IV. LPA STOPPING CRITERIA AND TIE RESOLUTION STRATEGIES

The paper compares stopping criteria and tie-resolution rules designed to control cycles and randomness in LPA. Deterministic priority tie-breaking guarantees convergence for synchronous LPA-Max up to cycles of size two.

  • IV. LPA STOPPING CRITERIA AND TIE RESOLUTION STRATEGIES: A simple no-change stopping rule can fail because LPA may enter cycles, including cycles that return to the initial labeling.The paper therefore discusses a more elaborate criterion based on local maximality.
  • IV. LPA STOPPING CRITERIA AND TIE RESOLUTION STRATEGIES: Criterion (c1) stops when every vertex already has a label maximizing the number of matching neighbors, so any next-step changes would arise only from ties.The current labeling then determines the network partition.
  • IV. LPA STOPPING CRITERIA AND TIE RESOLUTION STRATEGIES: LPA-Prec gives the current label priority whenever it satisfies the maximality condition, reducing randomization and typically improving stability, though it can stop earlier than standard LPA.Standard LPA may continue searching for better solutions in cases where LPA-Prec stops.
  • IV. LPA STOPPING CRITERIA AND TIE RESOLUTION STRATEGIES: LPA-Max resolves every tie deterministically by selecting the higher-priority label, such as the larger integer.A priority relation between every pair of labels is assumed.
  • IV. LPA STOPPING CRITERIA AND TIE RESOLUTION STRATEGIES: Synchronous LPA-Max cannot generate cycles larger than two, allowing termination when the labeling is unchanged from the previous step or repeats the labeling from two steps earlier.The result is stated as Fact 1 and its resulting stopping simplification.

V. SEMI–SYNCHRONOUS LABEL PROPAGATION

The paper proposes a semi-synchronous LPA for general graphs that combines parallel efficiency with convergence, using graph coloring to stage label propagation. A monotonicity argument proves convergence under the stated stopping criterion, independently of tie management.

  • V. SEMI–SYNCHRONOUS LABEL PROPAGATION: The semi-synchronous LPA combines synchronous efficiency and parallelizability with protection against oscillation.The authors present it as stable, efficient, and easy to parallelize while avoiding the oscillation problem.
  • V. SEMI–SYNCHRONOUS LABEL PROPAGATION: The algorithm colors vertices so adjacent nodes differ, then propagates labels simultaneously by color stages.Its two phases are a coloring phase followed by staged propagation, with each stage assigned to a different color.
  • V. SEMI–SYNCHRONOUS LABEL PROPAGATION: The coloring phase requires only O(deg(G)) synchronous parallel steps, while propagation stages are bounded by the number of colors.The paper also states that the number of stages per propagation step is bounded by deg(G) + 1.
  • V. SEMI–SYNCHRONOUS LABEL PROPAGATION: Under stop criterion (c1), Algorithm 3 converges independently of the tie-management rule.The stopping condition accepts unchanged labels or changes caused by ties.
  • V. SEMI–SYNCHRONOUS LABEL PROPAGATION: The convergence proof tracks monochromatic edges and shows their count grows monotonically when a non-tie relabeling occurs.The argument uses the coloring property to ensure neighbors retain their labels during such updates.

VI. EXPERIMENTAL RESULTS

The experiments compare asynchronous and semi-synchronous LPA variants across quality, timing, and stability on real networks with known community structures.

  • VI. EXPERIMENTAL RESULTS: The study compares asynchronous and semi-synchronous LPA using four tie-resolution strategies.The strategies are LPA, LPA-Prec, LPA-Max, and LPA-Prec-Max.
  • VI. EXPERIMENTAL RESULTS: The evaluation measures partition quality, execution timing, and stability across real networks with known community structures.These dimensions are compared for both propagation models.
  • VI. EXPERIMENTAL RESULTS: The experiments use real networks whose community structures are known.This enables direct comparison of the evaluated algorithms on the selected benchmark set.

A. Analyzed Network and their properties

The benchmark uses real networks with known community structures because generated and synthetic benchmarks may not adequately model real networks. The selected examples span social, competitive, and scientific collaboration networks.

  • A. Analyzed Network and their properties: The tests use real networks with known community structures rather than relying solely on generated benchmarks.The paper notes that generated networks cannot model real networks and that LFR benchmark results remain preliminary.
  • A. Analyzed Network and their properties: Benchmark selection is treated as crucial because the networks must support known community structure while representing real-network behavior.The paper frames the choice of test networks as a central evaluation concern.
  • A. Analyzed Network and their properties: The benchmark includes Karate, Dolphins, Football, and NetScience networks.These examples represent friendship, animal association, college football, and scientific coauthorship networks, respectively.

B. Test Settings

Each test setting combines a propagation timing, network, and tie-resolution strategy, with randomized initialization and repeated runs. The evaluation records timing, modularity-based quality, and stability indicators.

  • B. Test Settings: The study evaluates 56 settings formed by propagation timing, network choice, and tie-resolution strategy.Timing is asynchronous or semi-synchronous; networks and tie strategies are selected from the specified sets.
  • B. Test Settings: Each test is executed 100 times, using means and variances to compare performance under LPA randomization.Repeated runs address variability introduced by randomized behavior.
  • B. Test Settings: The protocol randomly assigns initial labels, colors the graph greedily, runs LPA, and identifies communities from connected nodes sharing a final label.Disconnected groups with the same label are treated as different communities.
  • B. Test Settings: Quality is measured by average modularity, while stability uses modularity deviation, community count, and largest-community size.The collected stability data support comparisons between the algorithms.

C. Results

The semi-synchronous approach preserves partition quality while improving efficiency and stability relative to asynchronous propagation, with outcomes shaped by tie-resolution strategy.

  • Quality: Quality remains comparable: semi-synchronous propagation slightly outperforms asynchronous propagation on Karate, Dolphins, and Football, but is slightly worse on NetScience, Power, and Cond-Mat.Performances are almost identical on the Internet network; the stated goal is to avoid degrading asynchronous quality rather than improve it.
  • Timing: The efficiency improvement ranges from ≈5.7× on Karate with LPA-Max to ≈1802× on Cond-Mat with LPA-Prec.The cited comparisons reduce propagation stages from 80 to 14 and from 528772 to 290, respectively.
  • Stability: Semi-synchronous propagation is more stable than asynchronous propagation, as measured by the standard deviation of modularity.Stability is also strongly influenced by tie-management strategy.
  • Stability: Tie resolution creates distinct trade-offs: LPA-Prec is more stable, whereas LPA-Max is especially unstable in several networks.LPA-Prec resolves ties in favor of its own label, while randomized initial labels affect how ties are resolved for LPA-Max.
  • Community structure: Semi-synchronous propagation slightly reduces the “monster” community phenomenon by producing smaller largest communities and more communities on average.

D. Discussion

The proposed semi-synchronized LPA combines synchronous parallelizability with asynchronous resistance to oscillation. Experiments show comparable accuracy, faster convergence, and greater stability, while convergence characterization remains open.

  • Conclusion: The strategy is effective, efficient, and stable: it preserves accuracy, supports parallelization, and limits randomization enough to produce uniform results.A simple stopping criterion defeats the oscillations that preclude synchronous strategies.
  • Conclusion: The four tie-resolution strategies trade off speed and stability: LPA-Max is fastest, LPA-Prec is most stable, and LPA-Prec-Max is a compromise.These characteristics are not influenced by whether propagation is asynchronous or semi-synchronous.
  • Open questions: Characterizing LPA convergence and determining its speed remain open problems.The paper specifically raises questions about asynchronous and semi-synchronous approaches and additional LPA variants.
Loading 1103.4550v1…