Source-linked AI summary

Measurement-conditioned Denoising Diffusion Probabilistic Model for Under-sampled Medical Image Reconstruction

Yutong Xie, Quanzheng Li

arXiv:2203.03623v1eess.IVcs.CV

TL;DR

Under-sampled medical reconstruction is commonly framed as estimating an image posterior from measurements, with prior work often seeking a single sample. MC-DDPM instead diffuses in measurement space conditioned on the under-sampling mask; in accelerated MRI, the authors report better evaluation metrics than baseline models and a score-based method, and use multiple samples to estimate uncertainty.

  • Problem

    Under-sampled medical reconstruction seeks an image posterior from incomplete measurements, while most prior works aim to obtain one posterior sample.

    Source: §1 · p. 1
  • Method

    MC-DDPM generates the non-sampled measurements by diffusion in measurement space conditioned on the under-sampling matrix and sampled measurements.

    Source: §3 · pp. 3–4
  • Results

    In accelerated MRI experiments, MC-DDPM is reported to outperform baseline models and Chung et al.’s score-based reconstruction method in evaluation metrics.

    Source: §1 · p. 2
  • Takeaways & Limitations

    Multiple posterior samples allow pixel variance to be computed by Monte Carlo to quantify reconstruction uncertainty.

    Source: §3 · p. 5

    The method assumes the sampled-measurement noise ϵM is zero.

    Source: §3 · p. 3

Abstract

from arXiv · show

We propose a novel and unified method, measurement-conditioned denoising diffusion probabilistic model (MC-DDPM), for under-sampled medical image reconstruction based on DDPM. Different from previous works, MC-DDPM is defined in measurement domain (e.g. k-space in MRI reconstruction) and conditioned on under-sampling mask. We apply this method to accelerate MRI reconstruction and the experimental results show excellent performance, outperforming full supervision baseline and the state-of-the-art score-based reconstruction method. Due to its generative nature, MC-DDPM can also quantify the uncertainty of reconstruction. Our code is available on github.

1 Introduction

The introduction frames under-sampled medical reconstruction as posterior estimation and proposes MC-DDPM, which diffuses in measurement space conditioned on the under-sampling mask. The authors report that it outperforms baseline models and a score-based reconstruction method in accelerated MRI experiments.

1 Introduction

  • Under-sampled medical reconstruction spans accelerated MRI, sparse-view or limited-angle CT, and digital breast tomosynthesis; most prior work seeks one sample from the posterior p(x | y).Here, x denotes the target image and y the under-sampled measurements.Source: §1 · p. 1
  • DDPM and score-based models generate samples by reversing diffusion, and have been used for unconditional image generation and conditional tasks such as inpainting and super-resolution.The introduction also notes applications to audio, graphs, and image editing.Source: §1 · pp. 1–2
  • MC-DDPM defines diffusion and sampling in measurement space, conditions diffusion on the under-sampling mask, and reports better evaluation metrics than baseline models and Chung et al.’s score-based method.The method can sample multiple reconstructions from the same measurements, enabling pixel-variance estimates of uncertainty.Source: §1 · p. 2, Figure 1 · p. 2

2 Background

The background describes DDPM as a learned reverse process for a gradual Gaussian-noise diffusion chain. It formulates under-sampled medical reconstruction as estimating an image or its posterior from fewer-dimensional measurements.

2.1 Denoising Diffusion Probabilistic Model

  • DDPM uses a Markov chain with learned Gaussian transitions from a standard Gaussian latent variable to data, reversing a forward process that gradually adds Gaussian noise.Its variance schedule is fixed so that q(xT | x0) is approximately N(0, I).Source: §2.1 · pp. 2–3
  • Sampling starts at xT from N(0, I) and repeatedly samples xt−1 until x0 is obtained; the forward process adds Gaussian noise according to a fixed variance schedule.The supplied background identifies β1, ..., βT as schedule constants.Source: §2.1 · p. 3

2.2 Under-sampled Medical Image Reconstruction

  • The forward model maps an image x ∈ R^n to under-sampled measurements y ∈ R^m, with m < n, using a measuring matrix, a sampling pattern, and noise.A is usually invertible; PΩ represents the under-sampling pattern, and the CT example uses a Radon transform and limited-angle sinogram.Source: §2.2 · p. 3
  • The reconstruction task is to estimate the posterior distribution of the image given the measurements and sampling matrix.The text notes that PΩ is usually omitted from the posterior notation.Source: §2.2 · p. 3

3 Method: Measurement-conditioned DDPM

MC-DDPM reconstructs under-sampled images by generating the missing measurements in the measurement domain, conditioned on the sampling mask and observed measurements. Its diffusion model is trained to generate those measurements, and multiple posterior samples support pixelwise uncertainty estimates.

3 Method: Measurement-conditioned DDPM

  • MC-DDPM estimates missing measurements conditioned on the sampling mask and observed measurements, then combines them with the known measurements to reconstruct the image.The method models the posterior over non-sampled measurements rather than reconstructing directly in the image domain.Source: §3 · pp. 3–4
  • Diffusion adds Gaussian noise to non-sampled measurements while keeping sampled positions zero; the reverse process generates the missing measurements.The covariance confines noise to non-sampled positions.Source: §3 · p. 4
  • Training optimizes a variational bound on negative log likelihood, with a reweighted simplified objective used in the training procedure.The paper presents the complete training procedure in Algorithm 1.Source: §3 · pp. 4–5
  • Sampling iteratively generates the non-sampled measurements, then applies the inverse measuring transform to the sum of generated and observed measurements.Algorithm 2 returns the reconstructed image from the combined measurements.Source: §3 · p. 5
  • Multiple posterior samples enable pixel-variance estimates to quantify reconstruction uncertainty.The variance is computed using a Monte Carlo approach.Source: §3 · p. 5

4 Experiments

The experiments evaluate MC-DDPM on accelerated knee MRI, comparing it with zero-filled reconstruction, U-Net, and a score-based method. They report improved reconstruction quality, examine sampling tradeoffs, and discuss broader applicability and a future hyperparameter investigation.

4.1 Experimental Setting

  • Experiments use fastMRI single-coil PD and PDFS knee data, with 320 × 320 complex images, and compare PSNR/SSIM against U-Net and the score-based method.The MRI operator is a 2D Fourier transform; the model uses magnitude images for final reconstructions and pixel-wise variance.Source: §4.1 · p. 5, §4 · p. 5

4.2 Experimental Results

  • For PD data at 4× and 8× acceleration, the proposed method’s mean of 20 reconstruction samples performs best versus zero-filled reconstruction and U-Net, showing more realistic structures and less zoomed-in error.Source: §4.2 · p. 5
  • MC-DDPM outperforms the score-based method by 3.62/0.077 (4×) and 2.96/0.089 (8×) in PSNR/SSIM, using average U-Net-relative enhancements because testing volumes differ.The study also reports that MC-DDPM performs best against zero-filled reconstruction and U-Net in the displayed PD results at both acceleration factors.Source: §4.2 · pp. 5–6, Table 1 · p. 6, Figure 2 · p. 6
  • On one PDFS volume, reducing sampling steps to 250 only slightly reduces PSNR, while increasing the sample count improves mean-image quality and appears to converge.The authors suggest 20 samples with 250 sampling steps as a possible efficiency-conscious choice.Source: §4.2 · p. 6, Figure 3 · p. 7, Figure 4 · p. 7

4.3 Discussion

  • Under-sampling commonly reduces imaging cost or dosage; the authors suggest MC-DDPM may extend beyond MRI, while further investigation of its variance schedule is planned.Limited-angle or sparse-view CT are named as possible applications, and the schedule {βt} is identified as a hyperparameter potentially related to sampling quality and efficiency.Source: §4.3 · p. 7

5 Conclusion

The conclusion presents MC-DDPM as a unified framework for reconstruction from under-sampled medical measurements. It applies diffusion in the measurement domain, conditions on the under-sampling mask, and outputs an uncertainty estimate; accelerated MRI demonstrates its performance.

  • MC-DDPM is presented as a unified mathematical framework for medical image reconstruction from under-sampled measurements.Source: §5 · p. 7
  • Its diffusion process operates in the measurement domain and is conditioned on the under-sampling mask.Source: §5 · p. 7
  • The framework provides an uncertainty estimate, and its performance is demonstrated on accelerated MRI reconstruction.Source: §5 · p. 7

7 Supplementary Materials

The supplementary materials derive the MC-DDPM training objective, specify the MRI experiment setup, and provide additional quantitative and visual reconstruction results.

7.1 Derivation of Eq. 8, Eq. 9 and Training Objective in Sect. 3

  • The derivation restricts the reverse conditional to non-sampled coordinates and obtains a reweighted MC-DDPM training objective from the variational bound.It derives q(yMc,t−1 | yMc,t, yMc,0, M, yM) and describes the final objective as a reweighted Lvlb.Source: §7.1 · pp. 10–12

7.2 More Details of Experiments

  • Experiments use a U-Net with time embeddings and self-attention, batch size 48 for 35k steps, and a cosine schedule with β_t multiplied by 0.5.The first and last five slices are dropped to avoid noise-only training data; testing uses six randomly selected validation volumes for PD and PDFS.Source: §7.2 · p. 12

7.3 More Experimental Results

  • Additional volume- and slice-level tables report PSNR, SSIM, NMSE, and MSE, but the supplied captions do not state their metric values.Table 2 covers volumes and Table 3 covers slices.Source: §7.3 · p. 12, Table 2 · p. 12, Table 3 · p. 12
  • Figures show 4× and 8× reconstructions on PD and PDFS; the 4× PD figure includes mean/std from 20 samples, five samples, and PSNR/SSIM.The captions specify that yellow numbers indicate PSNR and SSIM.Source: §7.3 · p. 12, Figure 5 · p. 13, Figure 6 · p. 14
Loading 2203.03623v1…