Academic

Structure-Aware Epistemic Uncertainty Quantification for Neural Operator PDE Surrogates

arXiv:2603.11052v1 Announce Type: new Abstract: Neural operators (NOs) provide fast, resolution-invariant surrogates for mapping input fields to PDE solution fields, but their predictions can exhibit significant epistemic uncertainty due to finite data, imperfect optimization, and distribution shift. For practical deployment in scientific computing, uncertainty quantification (UQ) must be both computationally efficient and spatially faithful, i.e., uncertainty bands should align with the localized residual structures that matter for downstream risk management. We propose a structure-aware epistemic UQ scheme that exploits the modular anatomy common to modern NOs (lifting-propagation-recovering). Instead of applying unstructured weight perturbations (e.g., naive dropout) across the entire network, we restrict Monte Carlo sampling to a module-aligned subspace by injecting stochasticity only into the lifting module, and treat the learned solver dynamics (propagation and recovery) as dete

arXiv:2603.11052v1 Announce Type: new Abstract: Neural operators (NOs) provide fast, resolution-invariant surrogates for mapping input fields to PDE solution fields, but their predictions can exhibit significant epistemic uncertainty due to finite data, imperfect optimization, and distribution shift. For practical deployment in scientific computing, uncertainty quantification (UQ) must be both computationally efficient and spatially faithful, i.e., uncertainty bands should align with the localized residual structures that matter for downstream risk management. We propose a structure-aware epistemic UQ scheme that exploits the modular anatomy common to modern NOs (lifting-propagation-recovering). Instead of applying unstructured weight perturbations (e.g., naive dropout) across the entire network, we restrict Monte Carlo sampling to a module-aligned subspace by injecting stochasticity only into the lifting module, and treat the learned solver dynamics (propagation and recovery) as deterministic. We instantiate this principle with two lightweight lifting-level perturbations, including channel-wise multiplicative feature dropout and a Gaussian feature perturbation with matched variance, followed by standard calibration to construct uncertainty bands. Experiments on challenging PDE benchmarks (including discontinuous-coefficient Darcy flow and geometry-shifted 3D car CFD surrogates) demonstrate that the proposed structure-aware design yields more reliable coverage, tighter bands, and improved residual-uncertainty alignment compared with common baselines, while remaining practical in runtime.

Executive Summary

This article proposes a novel structure-aware epistemic uncertainty quantification (UQ) scheme for neural operator PDE surrogates. The method restricts Monte Carlo sampling to a module-aligned subspace, injecting stochasticity only into the lifting module and treating the learned solver dynamics as deterministic. Experiments demonstrate improved reliability, tighter uncertainty bands, and better residual-uncertainty alignment compared to common baselines. This structure-aware design remains computationally efficient and practical for runtime. The proposed approach addresses significant epistemic uncertainty in NOs' predictions, making it a valuable contribution to scientific computing. Its practical implications and potential applications in risk management and decision-making warrant further exploration.

Key Points

  • Structure-aware epistemic UQ scheme for NO PDE surrogates
  • Module-aligned subspace for Monte Carlo sampling
  • Improved reliability and tighter uncertainty bands

Merits

Strength

The structure-aware design effectively handles epistemic uncertainty in NOs' predictions, leading to improved reliability and tighter uncertainty bands.

Methodological innovation

The proposed approach introduces a novel methodological innovation in UQ for NO PDE surrogates, addressing a significant challenge in scientific computing.

Demerits

Limitation

The method's performance may degrade if the lifting module is not well-trained or if the network architecture is complex.

Assumptions

The approach relies on the assumption that the learned solver dynamics are deterministic, which may not always hold in practice.

Expert Commentary

The proposed structure-aware UQ scheme for NO PDE surrogates is a significant contribution to the field of scientific computing. The method's ability to handle epistemic uncertainty in NOs' predictions with improved reliability and tighter uncertainty bands is a major achievement. However, the approach relies on assumptions about the learned solver dynamics, which may not always hold in practice. Further research is needed to explore the method's robustness and applicability to diverse scientific computing applications.

Recommendations

  • Future research should investigate the method's performance on more complex network architectures and a wider range of scientific computing applications.
  • The authors should provide more detailed analysis of the method's sensitivity to the lifting module's training and the assumptions about the learned solver dynamics.

Sources