Source-linked AI summary

Super-resolution via superset selection and pruning

Laurent Demanet, Deanna Needell, Nam Nguyen

arXiv:1302.6288v2cs.ITcs.NAmath.ITmath.NA

TL;DR

Sparse recovery from contiguous Fourier measurements is challenging because super-resolution can be arbitrarily ill-posed. The paper uses Fourier translation invariance for subspace identification in a pursuit-like method. It claims perfect noiseless ℓ0 recovery and reports numerical robustness in challenging coherent settings.

  • Problem

    Recovering sparse vectors from contiguous Fourier measurements in the super-resolution regime is challenging because the problem can be arbitrarily ill-posed.

    Source: §I · p. 1
  • Method

    The approach exploits translation invariance of partial Fourier columns to identify the signal subspace as part of a pursuit-like recovery method.

    Source: §I · p. 1, §II · p. 2
  • Results

    The method is claimed to provide perfect recovery for the noiseless ℓ0 problem, and numerical experiments report accurate recovery under high coherence where ℓ1 minimization fails on opposite-sign neighboring spikes.

    Source: §I · p. 1, §IV · p. 3
  • Takeaways & Limitations

    Numerical comparisons show matrix pencil can fare better for two-spike signals, while the superset method gains ground for progressively less sparse signals and can recover exactly with reasonably small noise at near-unit coherence.

    Source: §IV · p. 4

    The paper presents empirical evidence for the method and says further theoretical justifications will be presented elsewhere.

    Source: §V · p. 4

Abstract

from arXiv · show

We present a pursuit-like algorithm that we call the "superset method" for recovery of sparse vectors from consecutive Fourier measurements in the super-resolution regime. The algorithm has a subspace identification step that hinges on the translation invariance of the Fourier transform, followed by a removal step to estimate the solution's support. The superset method is always successful in the noiseless regime (unlike L1-minimization) and generalizes to higher dimensions (unlike the matrix pencil method). Relative robustness to noise is demonstrated numerically.

I. INTRODUCTION

The paper addresses sparse-vector recovery from contiguous Fourier measurements, a super-resolution setting that can be arbitrarily ill-posed. It proposes a pursuit-like method combining subspace identification and active-set removal, with claimed noiseless recovery and numerical advantages over matrix pencil in some cases.

I. INTRODUCTION

  • The target is recovery, or approximation, of a sparse vector from m ≤ n contiguous Fourier measurements.The measurement model uses a partial, short-and-wide Fourier matrix and allows additive noise.Source: §I · p. 1
  • Contiguous Fourier measurements permit neighboring nonzero components to be much closer than the Rayleigh limit n/m, but super-resolution can be arbitrarily ill-posed.The introduction contrasts these measurements with randomly drawn measurements in compressed sensing and notes open questions about recovery bounds and suitable algorithms.Source: §I · p. 1
  • The superset method combines subspace identification with a removal procedure that tightens the active set.The identification step is described as related to matrix pencil but omits its subsequent eigenvalue computation.Source: §I · p. 1
  • The method is claimed to provide perfect recovery for the noiseless ℓ0 problem and to generalize to higher dimensions.The authors also report that it can outperform the matrix pencil method in numerical experiments.Source: §I · p. 1

II. NOISELESS SUBSPACE IDENTIFICATION

The noiseless method exploits translation invariance of partial Fourier columns to identify a subspace containing the signal atoms, then tests candidate atoms and solves on the selected support. Under stated sampling and Hankel-length conditions, it exactly recovers the original vector.

II. NOISELESS SUBSPACE IDENTIFICATION

  • The classical uniqueness result states that x0 is the unique sparsest solution when m ≥ 2|T| and y = Ax0.This result is recalled as background for the recovery procedure.Source: §II · p. 1
  • Translation invariance of partial Fourier columns lets the method use translated copies of y in a Hankel matrix to obtain the subspace spanned by the signal atoms.Restrictions to consecutive entries reproduce the same sequence up to an overall scalar; the range of the Hankel matrix is the sought subspace.Source: §II · p. 2
  • For L ≥ |T|, the Hankel matrix has rank |T|, providing the subspace used to identify the support.The recovery procedure tests candidate atoms using their angle to the identified subspace.Source: §II · p. 2
  • After identifying T, the method obtains the solution by solving the determined system on that support.The resulting procedure is stated to solve the noise-free ℓ0 sparse-recovery problem.Source: §II · p. 2
  • When m > 2|T| and |T| + 1 ≤ L ≤ m − |T| − 1, the procedure recovers x0 exactly in the noiseless case.The proof relies on the partial Fourier matrix being full spark.Source: §II · p. 2
  • The matrix pencil approach computes rank-reducing numbers through generalized eigenvalues, whereas the superset procedure uses subspace identification followed by support removal.The cited discussion notes that Prony’s method is a matrix-pencil special case when L = |T| and should be avoided in practice if possible due to numerical inferiority.Source: §II · p. 2

III. NOISY SUBSPACE IDENTIFICATION

With noisy observations, the signal subspace may no longer equal the noiseless range, so recovery uses low-noise angle information to form a candidate support and then prunes it. The analysis gives high-probability bounds and describes practical estimates for unknown quantities.

III. NOISY SUBSPACE IDENTIFICATION

  • When noise is present, the signal range differs from Ran Y, but low-noise cases may still reveal the support through the smallest angles.The pruning step projects the observation onto the candidate range and retains indices only when the angle exceeds a threshold.Source: §III · pp. 2–3
  • Under Gaussian noise e ~ N(0, σ^2 I_m), Proposition 4 gives a high-probability singular-value bound for indices in the support.The proposition concerns the singular values of the noisy and noiseless Hankel matrices.Source: §III · p. 2
  • The procedure estimates support size with a large constant such as m/2 and assumes the signal dynamic range can be known beforehand.It replaces an unknown noiseless singular value using Weyl’s inequality; the perturbation is described as controllable with high probability.Source: §III · p. 3
  • The subspace-identification step returns a set expected to contain the true support, rather than the support itself.A second step removes candidates by testing whether the observation lies in the range after each candidate column is removed.Source: §III · p. 3
  • Algorithm 1 implements pruning iteratively, removing one atom at a time and stopping when the removal test no longer meets its threshold.The algorithm then computes a least-squares fit over the remaining candidate support.Source: §III · p. 3

IV. EXPERIMENTAL RESULTS

The experiments compare recovery on separated and clustered spikes, including settings with strong coherence and varying noise. The superset method handles several difficult clustered cases, while matrix pencil performs better in one special two-spike case and loses ground on less sparse signals.

IV. EXPERIMENTAL RESULTS

  • 0.075 was the superset method’s ∥bx − x0∥2 for well-separated spikes; ℓ1-minimization tended to form incorrect clusters around the true spikes.The comparison is shown in Fig. 1’s top row.Source: §IV · p. 3, Figure 1 · p. 4
  • For a strongly coherent signal with neighboring spike clusters, the superset method was accurate while ℓ1-minimization failed at least on opposite-sign clusters.The example used n = 1000 and m = 120.Source: §IV · p. 3, Figure 1 · p. 4
  • At reasonably small noise, the method recovers exactly even when coherence is nearly 1.The experiment varies measurements and noise for two neighboring spikes and reports success frequency over 100 noise realizations.Source: §IV · pp. 3–4
  • For a 2-spike signal, matrix pencil is often better, but it loses ground to the superset method in various progressively less sparse cases.The authors note that understanding matrix pencil performance would require a lower bound on typically very small singular values.Source: §IV · p. 4

V. CONCLUSION

The conclusion presents empirical evidence for the superset method as a viable computational approach to super-resolution, while deferring further theoretical justification.

  • The conclusion presents empirical evidence for the superset method’s potential as a viable computational approach to super-resolution.Source: §V · p. 4
  • Further theoretical justifications are deferred to later work.Source: §V · p. 4
  • Figure 2 compares recovery probability for the superset and matrix pencil methods across noise and coherence levels for 2-, 3-, and 4-sparse signals.Source: Figure 2 · p. 4
Loading 1302.6288v2…