Source-linked AI summary

Minimal Solvers for Mini-Loop Closures in 3D Multi-Scan Alignment

Pedro Miraldo, Surojit Saha, Srikumar Ramalingam

arXiv:1904.03941v1cs.CV

TL;DR

The paper addresses the lack of algebraic minimal solvers for jointly estimating poses in RGB-D scan loops. It develops solvers for mini n-cycles, and reports reduced estimation error and generally better results than pairwise methods in synthetic and real experiments.

  • Problem

    Higher-order pose estimation for RGB-D cameras had received no attention, despite progress on analogous RGB-camera problems.

    Source: §1 · p. 1
  • Method

    The paper derives minimal solvers that use two point correspondences to define virtual axes between scans, then estimate the remaining rotation angles jointly across an n-cycle.

    Source: §2 · p. 3, §2.1 · p. 4
  • Results

    N-cycle solvers reduce rotation and translation estimation error in simulations and generally outperform pairwise methods in real experiments.

    Source: §5.1 · p. 7, §5.2 · p. 7
  • Takeaways & Limitations

    The solvers provide alternate relative poses that can be used in pose-graph refinement or motion-averaging frameworks.

    Source: §6 · p. 8

    The n-cycle solver is not practically feasible for n>5; a six-cycle may have up to 288 solutions.

    Source: §2.5 · p. 5, §6 · p. 8

Abstract

from arXiv · show

3D scan registration is a classical, yet a highly useful problem in the context of 3D sensors such as Kinect and Velodyne. While there are several existing methods, the techniques are usually incremental where adjacent scans are registered first to obtain the initial poses, followed by motion averaging and bundle-adjustment refinement. In this paper, we take a different approach and develop minimal solvers for jointly computing the initial poses of cameras in small loops such as 3-, 4-, and 5-cycles. Note that the classical registration of 2 scans can be done using a minimum of 3 point matches to compute 6 degrees of relative motion. On the other hand, to jointly compute the 3D registrations in n-cycles, we take 2 point matches between the first n-1 consecutive pairs (i.e., Scan 1 & Scan 2, ... , and Scan n-1 & Scan n) and 1 or 2 point matches between Scan 1 and Scan n. Overall, we use 5, 7, and 10 point matches for 3-, 4-, and 5-cycles, and recover 12, 18, and 24 degrees of transformation variables, respectively. Using simulations and real-data we show that the 3D registration using mini n-cycles are computationally efficient, and can provide alternate and better initial poses compared to standard pairwise methods.

1. Introduction

The introduction motivates algebraic minimal solvers for RGB-D mini-cycles, where higher-order RGB-D pose estimation had received no attention. It presents joint registration of four scans from seven matches as an alternative to pairwise registration, which can accumulate drift.

1. Introduction

  • Higher-order RGB-D pose estimation had received no attention, despite progress on RGB-camera problems and the practical correspondence counts for n≤5.The introduction points to algebraic minimal solvers for depth sensors as a needed addition.Source: §1 · p. 1
  • Seven point matches jointly register four scans and recover 18 transformation variables, while pairwise methods can accumulate drift.The four-scan example uses a 4-cycle minimal solver.Source: §1 · p. 1, Figure 1 · p. 1

1.1. Related Work

  • Related work spans ICP and other 3D alignment methods, geometry-based SLAM, registration with semantic segmentation, and deep-learning approaches.The introduction also notes surveys of 3D SLAM evaluation and rigid and non-rigid point-cloud registration.Source: §1.1 · p. 2

1.2. Notation and Problem Definition

  • An n-cycle is a sequence of scans with loop closure between the first and last point clouds; the goal is to find transformations between scan coordinate systems.The notation section represents these transformations in SE(3).Source: §1.2 · p. 2

1. Introduction

  • The paper proposes minimal solvers for 3-, 4-, and 5-cycles in general six-degree-of-freedom and planar-motion settings.The authors describe these cases as novel to the best of their knowledge.Source: §1.2 · p. 2

2. Minimal Solvers

The solvers simplify multi-scan registration by aligning frames around axes defined by point matches, then jointly solving the remaining rotations around a loop. The approach is developed for 3-, 4-, and 5-cycles.

2. Minimal Solvers

  • Predefined transformations align scan frames around virtual axes through matched points, reducing the registration variables to rotations around those axes.After solving, inverse predefined transformations recover poses in the original coordinate frames.Source: §2 · p. 3

2.1. Setting the Stage for Minimal Solvers

  • Two point correspondences between each consecutive scan pair define the virtual axes, leaving one rotation angle per pair to estimate.For three scans, Figure 2 depicts the remaining degrees of freedom after these transformations.Source: Figure 2 · p. 3, §2.1 · p. 4

2.2. Pairwise Registration

  • For pairwise registration, a third point correspondence yields a closed-form solution, with up to two candidates when noisy data violate the trigonometric constraint.The candidates preserve a rotation matrix and can be checked by back-substitution.Source: §2.2 · p. 4

2.3. 3-Cycle Registration

  • For a 3-cycle, two residual angles are solved separately using one closing correspondence, producing up to four valid solutions.Each closure point correspondence supplies three constraints for the two unknown angles.Source: §2.3 · pp. 4–5

2.4. 4-Cycle Registration

  • For relative-pose recovery, three equations in three unknowns mean a single point correspondence can generally yield a solution; the automatic Gröbner-basis generator returns up to 16 solutions.The solver combines three constraints with three trigonometric constraints.Source: §2.4 · p. 5

2.5. 5-Cycle Registration

  • The general n-cycle formulation uses two correspondences to close the loop and yields 32 solutions for n = 5; the authors report it feasible only through n = 5.For n = 6, it may yield up to 288 solutions, with no easy way to build the solver.Source: §2.5 · p. 5

3. Planar Motion Case

For planar motion, the scans have three degrees of freedom, and the solver needs only one 3D point correspondence per scan pair. Because the planar pairwise minimum is two points, the paper considers mini-loops of up to four scans.

3. Planar Motion Case

  • Planar motion has 3 degrees of freedom: 2 translations and 1 rotation.Source: §3 · p. 5
  • Choosing the z-axis as the rotation axis makes the second correspondence in the general construction unnecessary, leaving one 3D correspondence per scan pair.Source: §3 · pp. 5–6
  • The planar-motion table summarizes the minimum correspondence counts for n-cycles; because pairwise registration requires two points, the paper considers cycles of at most four scans.Source: Table 2 · p. 6, §3 · p. 6

4. Motion Averaging

The method builds a pose graph from scan overlap, decomposes it into edge-disjoint mini-cycles, and uses the resulting redundant pose estimates for averaging. Rotation averaging uses an L1 initialization followed by IRLS, while translations are estimated by least squares.

4. Motion Averaging

  • Pose-graph edges connect camera pairs with scene overlap, identified using SURF matches on RGB images and a minimum feature-correspondence threshold.Source: §4 · p. 6
  • A depth-first search extracts edge-disjoint cycles, prioritizing 5-cycles, then 4-cycles, then 3-cycles; remaining edges use pairwise registration.Source: §4 · p. 6
  • The solver timing table reports milliseconds for a Matlab implementation; the caption notes that C++ would speed up computation.Source: Table 3 · p. 6
  • Redundant relative poses are averaged: an L1 rotation solution initializes IRLS, after which translations are computed by linear least squares.Source: §4 · p. 6

5. Experimental Results

Experiments compare pairwise registration with mini-cycle solvers on synthetic and TUM RGB-D scans. Mini-cycles generally outperform pairwise methods on real five-scan sequences, while the 5-cycle has the lowest synthetic rotation and translation errors but also the fewest inliers.

5. Experimental Results

  • The experiments include small n-cycle graphs and larger datasets decomposed into edge-disjoint cycles, with error evaluated against ground truth.Source: §5 · p. 6

5.1. Synthetic Data

  • The synthetic study tests five scans with pairwise, 3-cycle, 4-,2-cycle, and 5-cycle approaches, using 1000 RANSAC iterations and a 50-unit inlier threshold.Source: Figure 4 · p. 7, §5.1 · p. 7
  • In synthetic trials, n-cycle solvers reduce overall rotation and translation error; the 5-cycle has the lowest errors but also the lowest inlier count.Source: §5.1 · p. 7, Figure 4 · p. 7

5.2. Real Experiments

  • Real-data evaluation uses three TUM sequences with ground-truth camera positions, SURF matches on RGB images, and corresponding depth points.Source: §5.2 · p. 7
  • On TUM five-scan sequences, n-cycle methods generally outperform pairwise registration, and the 5-cycle yields better rotation errors.Table 4 also reports how often n-cycles outperform Pairwise.Source: §5.2 · p. 7, Table 4 · p. 8
  • For the larger TUM pose graphs, rotation averaging produces camera rotations and least squares estimates translations; the final registrations show 100 scans from each sequence.Source: §5.2 · p. 8, Figure 5 · p. 8

6. Discussion

The paper argues that n-cycle solvers jointly estimate camera poses with fewer correspondences than pairwise methods, and are exactly minimal rather than near-minimal. They also offer alternate relative poses for refinement, although solving cycles larger than five was not practically feasible.

  • For four cameras, the n-cycle method uses 7 point correspondences, versus a minimum of 9 for pairwise methods.Source: §6 · p. 8
  • Table 5 reports solver edge coverage and average rotation and translation errors for the registrations shown in Fig. 5.Source: Table 5 · p. 8, §6 · p. 8
  • The authors characterize their n-cycle solvers as exactly minimal, not near-minimal.Source: §6 · p. 8
  • The solvers provide alternate relative poses that may benefit pose-graph refinement or motion averaging, but solving n-cycles with n > 5 was not practically feasible.Source: §6 · p. 8
Loading 1904.03941v1…