Source-linked AI summary

Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flows

Kai Fukami, Koji Fukagata, Kunihiko Taira

arXiv:2301.10937v2physics.flu-dyncs.LGphysics.comp-ph

TL;DR

Machine-learning super resolution addresses reconstruction of high-resolution vortical-flow fields from low-resolution or spatially limited data. The paper surveys model architectures and physics-based losses, then demonstrates reconstruction in turbulence case studies. Physics-inspired designs support reconstruction with limited training data and noisy inputs, while training-data requirements remain a major challenge for real-world applications.

  • Problem

    High-resolution vortical-flow fields must be reconstructed from low-resolution data, but standard machine-learning outputs may violate physical conditions and many applications lack paired high-resolution data.

  • Method

    The paper surveys supervised, convolutional, GAN-based, and physics-informed super-resolution approaches and evaluates CNN-based reconstruction with physics-based loss functions and physics-inspired structures.

  • Results

    Physics-based loss functions or physics-inspired neural-network structures reconstruct vortical flows with limited training data and noisy inputs; the DSC/MS model reaches an L2 norm error of 0.241 in the turbulence case study.

  • Takeaways & Limitations

    Physics-inspired designs can support super-resolution reconstruction of vortical flows from spatially limited measurements and extend analysis toward numerical and experimental flow data.

  • Takeaways & Limitations

    Successful reconstruction still requires learning the relationship between coarse and high-resolution vortical flows from paired or unpaired training data, while physics-inspired losses can suffer large numerical errors when qHR is noisy.

Abstract

from arXiv · show

This paper surveys machine-learning-based super-resolution reconstruction for vortical flows. Super resolution aims to find the high-resolution flow fields from low-resolution data and is generally an approach used in image reconstruction. In addition to surveying a variety of recent super-resolution applications, we provide case studies of super-resolution analysis for an example of two-dimensional decaying isotropic turbulence. We demonstrate that physics-inspired model designs enable successful reconstruction of vortical flows from spatially limited measurements. We also discuss the challenges and outlooks of machine-learning-based super-resolution analysis for fluid flow applications. The insights gained from this study can be leveraged for super-resolution analysis of numerical and experimental flow data.

1 Introduction

Super resolution reconstructs high-resolution fluid fields from low-resolution data, extending image-reconstruction ideas to broader fluid-mechanics inverse problems. This paper surveys machine-learning approaches, applications, physics-informed designs, and turbulence case studies for vortical-flow reconstruction.

  • Super resolution reconstructs a spatially high-resolution field qHR from its low-resolution counterpart qLR, but conventional techniques struggle with high-wavenumber contexts.Machine learning is introduced to address this reconstruction difficulty.
  • Machine-learning super resolution applies image-science models to fluid data by replacing RGB channels with velocity components.These methods join broader machine-learning applications in turbulence modeling, reduced-order modeling, data reconstruction, and flow control.
  • Fluid-flow super resolution also frames global reconstruction from sparse sensors, denoising of noisy measurements, and subgrid refinement within LES.Low-resolution images can represent sparse measurements, while low-resolution data can also be interpreted as noisy experiments or coarse simulation fields.
  • The paper surveys machine-learning models and applications, then studies supervised reconstruction of two-dimensional decaying isotropic turbulence with physics-informed model designs.It also discusses challenges and outlooks for machine-learning-based super resolution in fluid-flow applications.

2 Approaches

The paper organizes fluid-flow super-resolution around fully connected networks, CNNs, and GANs, while also considering physics-based loss functions. These approaches learn mappings from lower-dimensional inputs to high-resolution flow fields, with model choice shaped by data and computational constraints.

  • Overview: Super-resolution models learn a nonlinear mapping from lower-dimensional qLR to higher-dimensional qHR using trained data.The model is represented as qHR = F(qLR), where F is the super-resolution model.
  • Fully-connected network: Fully-connected networks optimize model weights by minimizing a reconstruction loss through backpropagation.The loss can use L2, L1, or logarithmic norms depending on data characteristics and whether outlier sensitivity or underestimation matters.
  • Fully-connected network: Fully-connected models can become prohibitively expensive as decoder dimensions and connections grow in high-dimensional flow reconstruction.This computational burden motivates attention to memory requirements and alternatives such as CNNs.
  • Convolutional neural network: CNNs use shared filters to process large vortical-flow data while reducing dimensionality through pooling and expanding it through upsampling or resizing.Upsampling or interpolation can align input and output dimensions while avoiding some pooling or upsampling operations.
  • Generative adversarial network: GAN-based super resolution uses a generator and discriminator, making it attractive when paired high- and low-resolution training data are difficult to obtain.The generator produces candidate images, while the discriminator evaluates whether outputs resemble realistic data; physics-based losses can additionally constrain reconstructions.

3 Applications

This section surveys supervised, semisupervised, and unsupervised machine-learning approaches for reconstructing fluid-flow fields, including applications to vortical, experimental, meteorological, and reduced-order settings. Across these applications, model design incorporates multiscale structure, physical constraints, temporal information, or adaptive sampling to improve reconstruction and compression.

  • Supervised learning: Supervised CNN models reconstruct fluid flows from paired low- and high-resolution data, with applications spanning wakes, turbulence, and channel flows.The surveyed CNN approaches include a hybrid downsampled skip-connection/multi-scale model designed to capture multiscale turbulent physics.
  • Supervised learning: Transfer learning, multiple paths, and physics-informed design are used to incorporate spatial scales and domain knowledge into supervised reconstruction.SURFNet transfers weights from low-resolution training before high-resolution training, while multiple-path models capture variations in spatial temperature distributions.
  • Supervised learning: MTPC improves reconstruction of kinetic energy spectra and the second and third velocity-gradient invariants in forced isotropic turbulence and turbulent channel flow.The model simultaneously incorporates spatial and temporal information.
  • Supervised learning: Approximately 0.05% data compression was achieved when adaptive low-resolution inputs guided by local spatial standard deviation reconstructed a three-dimensional square-cylinder wake.The adaptive procedure varies downsampling according to the importance of local flow structures.
  • Supervised learning: Combining spatial super-resolution with temporal inbetweening reconstructed turbulent channel flows from two coarse snapshots with 0.04% data compression.The method uses spatial reconstruction followed by inbetweening between the beginning and end frames.
  • Supervised learning: CNN models also estimate high-resolution heat flux from wall measurements and reconstruct meteorological temperature fields across cities with reduced computational time.For cross-city temperature reconstruction, building height information was important for successful reconstruction.
  • Supervised learning: Applications extend to experimental PIV, sparse sensors, physics-based losses, and GAN-based models for reconstructing flow fields from limited or indirect measurements.Examples include particle-image velocity estimation, shallow-decoder reconstruction from local sensors, divergence-free loss terms, and cycle-GAN frameworks.

4 Case study: super-resolution reconstruction of turbulence

The case study evaluates six machine-learning models for reconstructing high-resolution two-dimensional turbulent vorticity from coarse data. Physics-inspired loss terms and interconnected DSC/MS designs improve vortical and fine-scale reconstruction, while nonlinear-term estimation remains more difficult.

  • Models and objectives: The models include regular CNN, DSC/MS, and interconnected DSC/MS architectures trained with either standard or physics-based loss functions.The physics-based loss combines vorticity, advection, and viscous-diffusion terms.
  • Case-study setup: The study reconstructs 512^2 high-resolution vortical fields from 16^2 low-resolution fields generated by average pooling.Six models are evaluated with βadv = βvisc = 0.1.
  • Reconstruction results: Regular CNNs reconstruct large vortices but produce pixelized rotation and shear structures, with L2 errors exceeding 0.5; DSC/MS reduces the error to 0.241.Embedding DSC functions and multi-scale filters improves reconstruction of large vortical structures.
  • Reconstruction results: Physics-based optimization and internal DSC/MS interconnections improve reconstruction of fine shear layers around large vortices, especially at higher Reynolds numbers.Improved models include DSC/MS-Lphys, IDSC/MS-L2, and IDSC/MS-Lphys.
  • Physics-based evaluation: Interconnected DSC/MS models better reconstruct the linear and nonlinear derivative terms, although nonlinear-term errors remain higher than linear-term errors.Derivative-based evaluation is stringent because high-order derivatives amplify high-wavenumber errors.
  • Data efficiency and robustness: Reconstruction error decreases with more training snapshots, while interconnections and physics-based loss enable qualitative reconstruction with fewer snapshots and improve robustness to noisy inputs.For γ > 0.3, DSC/MS models using physics-based loss are more robust than models trained with simple L2 optimization.

5 Extensions

The paper extends super-resolution beyond fixed, regular image-like inputs to changing sensor layouts, irregular grids, simulation subgrid physics, and real-world sparse measurements. These extensions require specialized representations and remain bounded by input compatibility, coarse-field accuracy, training data, and generalizability.

  • Changing input variable setups: Changing input size or sensor locations generally requires retraining, and standard CNNs may not suit unstructured or randomly sampled data.Interpolation can preprocess different-size inputs but may lose information.
  • Changing input variable setups: Point-cloud networks, graph neural networks, coordinate transformations, and Voronoi projections provide alternatives for sparse, irregular, or moving sensor arrangements.These approaches adapt convolution or projection to nonstandard spatial data.
  • Super resolution for turbulent flow simulations: Super-resolution may be incorporated into simulations to reconstruct subgrid-scale physics, but physically accurate output requires accurate low-resolution input on its own coarse grid.The paper cautions that super-resolution should not be expected to transform LES or other turbulence-model results into DNS results.
  • Challenges and outlook: Broader adoption requires methods that generalize across Reynolds numbers and turbulent-flow problems for robust and reliable performance.The paper identifies this generalizability as critical for extended flow analysis and simulation use.
  • Applications to real-world problems: Existing methods still require paired or unpaired training data, while real-world problems often provide only sparse and noisy measurements.Data assimilation is proposed as a way to combine observations with short-range forecasts.
  • Applications to real-world problems: Four-dimensional super-resolution data assimilation combines temporal evolution from low-resolution simulations with simultaneous machine-learning-based assimilation and super resolution.The approach was demonstrated for a two-dimensional periodic channel flow.
  • Applications to real-world problems: Most studies target a particular flow problem, variable, or data shape; future work could combine point-wise, image-based, and online measurements to predict unavailable parameters.The proposed direction addresses multimodal and sparse measurement settings.

6 Conclusions

The paper surveys machine-learning-based super-resolution for vortical flows, combining physics-based designs with discussion of broader extensions and unresolved challenges. Its case studies show that physics-based losses or physics-inspired neural-network structures can reconstruct vortical flows despite limited training data and noisy inputs.

  • Conclusions: CNN-based case studies demonstrated vortical-flow reconstruction using physics-based loss functions or physics-inspired neural-network structures.These approaches were evaluated for turbulent-flow super-resolution reconstruction.
  • Conclusions: The survey discusses extensions through changing input-variable setups and applications to turbulent-flow simulations.
  • Future directions: Multi-scale CNN filters and physics-informed loss functions can extend across supervised and unsupervised models.The survey also identifies wave-space models as a possible route for incorporating spectral properties.
  • Challenges: Existing studies generally use clean training data, making robustness to noisy inputs and uncertainty quantification important for reliable industrial applications.The paper also emphasizes the need for accessible computational and experimental fluid-flow databases.

Declarations

The declarations report no conflict of interest, identify the authors' roles, and state that supporting data are available from the corresponding author upon reasonable request.

  • Conflict of interest: The authors declare that they have no conflict of interest.
  • Author contributions: Ka.F, Ko.F, and KT designed the research, while Ka.F performed the research and analyzed the data.
  • Author contributions: Ka.F and KT wrote the paper, and Ko.F and KT supervised the study.
  • Data availability: The study's supporting data are available from the corresponding author upon reasonable request.
Loading 2301.10937v2…