Source-linked AI summary

DHGCN: Dynamic Hop Graph Convolution Network for Self-Supervised Point Cloud Learning

Jincen Jiang, Lizhi Zhao, Xuequan Lu, Wei Hu, Imran Razzak, Meili Wang

arXiv:2401.02610v2cs.CV

TL;DR

Point-cloud GCNs often focus on local point-set features and leave relationships between sets unmodeled. DHGCN reconstructs hop distances between voxelized parts and uses them in attention; the authors report state-of-the-art results on downstream classification and part segmentation tasks.

  • Problem

    Point-cloud GCNs commonly learn local features of grouped point sets while overlooking contextual relationships between the sets.

    Source: Introduction · p. 1
  • Method

    DHGCN reconstructs part-level graph hop distances as a self-supervised task and uses the learned distances in Hop Graph Attention to weight edge features during aggregation.

    Source: Introduction · p. 2
  • Results

    DHGCN outperforms state-of-the-art unsupervised methods on downstream classification and part segmentation tasks.

    Source: Conclusion · p. 7
  • Takeaways & Limitations

    DHGCN is designed as a plug-and-play module that can be incorporated into point-based backbone networks.

    Source: Introduction · p. 2

    DHGCN is less effective on data with large perturbations, which can cause inaccurate part splits and misleading adjacency relationships.

    Source: Downstream Tasks · p. 6

Abstract

from arXiv · show

Recent works attempt to extend Graph Convolution Networks (GCNs) to point clouds for classification and segmentation tasks. These works tend to sample and group points to create smaller point sets locally and mainly focus on extracting local features through GCNs, while ignoring the relationship between point sets. In this paper, we propose the Dynamic Hop Graph Convolution Network (DHGCN) for explicitly learning the contextual relationships between the voxelized point parts, which are treated as graph nodes. Motivated by the intuition that the contextual information between point parts lies in the pairwise adjacent relationship, which can be depicted by the hop distance of the graph quantitatively, we devise a novel self-supervised part-level hop distance reconstruction task and design a novel loss function accordingly to facilitate training. In addition, we propose the Hop Graph Attention (HGA), which takes the learned hop distance as input for producing attention weights to allow edge features to contribute distinctively in aggregation. Eventually, the proposed DHGCN is a plug-and-play module that is compatible with point-based backbone networks. Comprehensive experiments on different backbones and tasks demonstrate that our self-supervised method achieves state-of-the-art performance. Our source code is available at: https://github.com/Jinec98/DHGCN.

Introduction

Point-cloud GCNs often learn local point-set features while overlooking relationships between point sets. DHGCN uses reconstructed graph hop distances to learn those contextual relationships and guide feature aggregation.

Introduction

  • Existing point-cloud GCNs commonly build local graphs for grouped point sets and focus on local features, leaving contextual relationships between sets unmodeled.Point clouds’ irregular point distributions also make traditional image CNNs difficult to apply directly.Source: Introduction · pp. 1–2
  • Graph hop distance provides a quantitative measure of adjacency between point parts, motivating its use to represent their contextual relationships.The paper’s figure constructs graph nodes from voxelized parts and depicts hop distance as shortest-path length.Source: Figure 1 · p. 1, Introduction · p. 2
  • DHGCN voxelizes point clouds into graph nodes and reconstructs a part-level hop-distance matrix as a self-supervised task for learning contextual relationships.The dynamically updated distance matrix supervises learning and supplies geometric information to Hop Graph Attention, which weights edge features during aggregation.Source: Introduction · p. 2
  • The paper contributes Hop Graph Attention and a hop-distance loss, and reports state-of-the-art performance across different downstream tasks.DHGCN is also designed as a plug-and-play module for point-based backbones.Source: Introduction · p. 2

Related Work

Related work covers self-supervised point-cloud representations, graph-based local feature learning, and attention mechanisms. DHGCN’s HGA differs by targeting contextual relationships between point sets and explicitly providing geometric information.

Self-supervised Point Cloud Learning

  • Point-cloud self-supervised methods use contrastive objectives across transformed views or reconstruct intra-cloud information from degraded inputs.Examples include matching point clouds to rendered images and completing occluded clouds.Source: Self-supervised Point Cloud Learning · p. 2

Graph-based Learning Methods

  • Graph-based point-cloud methods commonly use kNN or radius neighborhoods and develop local feature extractors for the resulting point sets.The cited examples include DGCNN’s EdgeConv, deformable kernels, adaptive kernels, and deeper GCN architectures.Source: Graph-based Learning Methods · p. 2

Attention Mechanism

  • Prior attention methods assign weights to graph neighbors or point features, whereas DHGCN’s HGA explicitly learns contextual relationships between point sets using geometric information.The paper motivates this approach through the adjacency structure among parts.Source: Attention Mechanism · pp. 2–3

Method

DHGCN combines part-level graph construction, hop-distance prediction, and Hop Graph Attention to embed geometric information into point features.

Method

  • DHGCN voxelizes the cloud into graph nodes, predicts their hop-distance matrix as a self-supervised signal, and uses that matrix in HGA to embed learned geometry into point features.The architecture extracts part features while predicting the distance matrix.Source: Method · p. 3
  • The predicted hop distances represent the degree of adjacency between nodes and provide the contextual information that HGA embeds into point features.This connects the graph’s pairwise neighboring relationships to the point-feature representation.Source: Method · p. 3
  • DHGCN extracts part features alongside distance prediction, using the predicted matrix as input to Hop Graph Attention.The passage identifies HGA as the stage that embeds learned geometric information into point features.Source: Method · p. 3

Volumetric Partition

The point cloud is divided into voxel parts, which become graph nodes connected according to intersections between their up-scaled bounding boxes.

Volumetric Partition

  • Volumetric partition maps each point to one of V = s^3 voxel parts, with each part storing the indices of its points.Each part’s axis-aligned bounding box is up-scaled by a factor of 1.2; an empty part receives a bounding box of volume 0.Source: Volumetric Partition · p. 3
  • Two graph nodes connect when their bounding boxes intersect, and each node also has a self-loop.The graph distance is the shortest-path edge count; the maximum is truncated to s + 1 hops and self-distance is 0.Source: Volumetric Partition · p. 3
  • The resulting distance matrix encodes pairwise adjacency degree through shortest-path hop counts.The maximum hop distance is truncated to s + 1.Source: Volumetric Partition · p. 3

Part Feature Extraction

Point-based networks produce point-wise features from the input cloud, then pool them globally or within parts. DHGCN uses part-level pooling to obtain features for its voxelized parts.

Part Feature Extraction

Hop Graph Convolution Module

DHGCN predicts hop distances between voxelized parts and uses them to guide graph attention and revise point-wise features. The described visual comparison reports features more distinctive than DGCNN and more related to geometric distance and shape.

Part Convolution

  • DHGCN initializes a graph over parts and uses part-level graph convolution to extract local geometric representations from edge features.The edge features combine shape information with neighborhood feature differences; PartConv projects them to new edge features.Source: Part Convolution · p. 4

Hop Distance Reconstruction

  • A self-supervised task predicts pairwise hop distances as δ + 1 classes, while each layer’s predicted distance matrix is supervised by the ground-truth matrix.The ground-truth graph uses voxel parts and their scaled axis-aligned bounding boxes to determine adjacency.Source: Hop Distance Reconstruction · p. 4, Figure 3 · p. 4

Hop Graph Attention

  • Hop Graph Attention uses predicted hop distances to produce attention coefficients, giving edge features distinct contributions during aggregation.Its stated goal is to assign more weight to parts with fewer hops; normalized coefficients are compared across connected neighbors.Source: Hop Graph Attention · p. 4

Revising Point-wise Features

Dynamic Hop Distance

  • Unlike local-graph methods, DHGCN uses a complete global graph whose hop distances are dynamically updated and supervised across layers.The Gaussian kernel assigns more attention to neighboring parts and less to distant parts; the self-supervised loss uses the HopGraphConv layers.Source: Part Convolution · p. 4, Dynamic Hop Distance · p. 5

Experimental Results

Experiments evaluate DHGCN across pretraining datasets, downstream classification and segmentation tasks, and ablations. The reported results include leading benchmark comparisons and performance changes with attention and hop-loss settings.

Experimental Setting

  • Classification uses split number 3 and maximum hop distance 4, while segmentation uses split number 5; HGA uses four attention heads and Gaussian-kernel σ is 1 by default.Experiments use SGD, batch size 32, and one TITAN RTX GPU.Source: Experimental Setting · p. 5

Pretraining

  • DHGCN is pretrained on ShapeNet's 57,448 models across 55 categories and also on ModelNet40's 9,840 training models, then evaluated using a frozen encoder and linear classifier.ShapeNet pretraining uses 2,048 points; ModelNet40 pretraining uses 1,024 points.Source: Pretraining · p. 5

Downstream Tasks

  • 93.2% (ShapeNet) and 93.3% (ModelNet40): DHGCN achieves state-of-the-art ModelNet40 classification, exceeding SSC by 0.8% and GraphTER by 1.3%, respectively.Table 1 compares unsupervised methods and identifies ShapeNet/ModelNet40 as the pretraining datasets.Source: Downstream Tasks · pp. 5–6, Table 1 · p. 6
  • DHGCN achieves state-of-the-art results at all five ModelNet40 training-data ratios; with 1% data, it reaches 62.7% accuracy, exceeding MAE3D by 1% and FoldingNet by 6.3%.With 20% and 10% of training data, accuracy is 89.1% and 86.1%, respectively.Source: Downstream Tasks · p. 6, Table 2 · p. 6
  • 85.9% on OBJ BG: DHGCN exceeds compared unsupervised methods by at least 4.2%; on PB T50 RS it reaches 81.9%, where the authors suspect perturbation noise disrupts part adjacency.On OBJ BG, it also surpasses the DGCNN backbone by 3.1%.Source: Downstream Tasks · p. 6, Table 3 · p. 6
  • DHGCN achieves state-of-the-art performance over recent unsupervised methods on ShapeNet Part segmentation, evaluated with two mIoU types and PAConv as backbone.With limited training data, PAConv-backed DHGCN reaches 76.9% and 81.9% instance mIoU using 1% and 5% of training data, respectively.Source: Downstream Tasks · pp. 6–7, Table 4 · p. 7, Table 5 · p. 7

Ablation Studies

  • 0.5%: HGA exceeds the supervised SA baseline; applying hop-distance loss in each layer yields 94.6% versus 93.3% hop prediction accuracy and 93.3% versus 93.1% classification accuracy.The table reports hop-distance prediction and point-cloud classification accuracy.Source: Ablation Studies · p. 7, Table 6 · p. 7
  • 93.3% accuracy occurs at Gaussian-kernel σ² = 1.0; σ² = 0.2 reduces accuracy to 92.6%, while σ² = 2.0 and 5.0 yield 93.0% and 92.9%.The authors attribute the lower results at small σ² to a receptive field reduced to one-hop neighbors, and at larger σ² to less distance distinction.Source: Ablation Studies · p. 7, Table 7 · p. 7

Conclusion

DHGCN learns contextual relationships between point parts through self-supervised hop-distance reconstruction and uses dynamically updated distances in HGA aggregation. It outperforms state-of-the-art unsupervised methods on classification and part segmentation, but is less effective with large perturbations.

  • DHGCN outperforms state-of-the-art unsupervised methods on downstream classification and part segmentation tasks.Source: Conclusion · p. 7
  • The self-supervised part-level hop-distance reconstruction task and hop-distance loss learn contextual relationships between point parts.Source: Conclusion · p. 7
  • HGA embeds dynamically updated hop distances as attention weights to determine point parts’ importance during feature aggregation.Source: Conclusion · p. 7
  • DHGCN is less effective on data with large perturbations, where noisy voxelization can produce misleading adjacent relationships.Source: Conclusion · p. 7
Loading 2401.02610v2…