Enhancing training of physics-informed neural networks using domain decomposition-based preconditioning strategies

Artificial neural networks and deep learning (68T07) Large-scale problems in mathematical programming (90C06) Nonconvex programming, global optimization (90C26) Nonlinear programming (90C30) Multigrid methods; domain decomposition for initial value and initial-boundary value problems involving PDEs (65M55)

Cites Work

Title not available (Why is that?)
Title not available (Why is that?)
Title not available (Why is that?)
On the limited memory BFGS method for large scale optimization
Representations of quasi-Newton matrices and their use in limited memory methods
The Deep Ritz Method: a deep learning-based numerical algorithm for solving variational problems
DGM: a deep learning algorithm for solving partial differential equations
Numerical solution of nonlinear Klein-Gordon equation using the element-free KP-Ritz method
Exact imposition of boundary conditions with distance functions in physics-informed deep neural networks
PFNN: a penalty-free neural network method for solving a class of second-order boundary-value problems on complex geometries
Parallel physics-informed neural networks via domain decomposition
When and why PINNs fail to train: a neural tangent kernel perspective
A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
Conservative physics-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
Variable projection for nonlinear least squares problems
Decomposition and composition of deep convolutional neural networks and training acceleration via sub-network transfer learning
Nonlinear field-split preconditioners for solving monolithic phase-field models of brittle fracture
Composing scalable nonlinear algebraic solvers
Newton Methods for Nonlinear Problems
Fast Curvature Matrix-Vector Products for Second-Order Gradient Descent
Separable nonlinear least squares: the variable projection method and its applications
Nonlinearly Preconditioned Inexact Newton Algorithms
Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
The Dawning of a New Era in Applied Mathematics
Layer-Parallel Training of Deep Residual Neural Networks
When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?
PFNN-2: A Domain Decomposed Penalty-Free Neural Network Method for Solving Partial Differential Equations
Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs
Locally adaptive activation functions with slope recovery for deep and physics-informed neural networks
Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations
Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection
Subdivision-Based Nonlinear Multiscale Cloth Simulation
Field-Split Preconditioned Inexact Newton Algorithms
\(\text{PIN}^{\mathcal L}\) : Preconditioned Inexact Newton with Learning Capability for Nonlinear System of Equations
Multilevel Objective-Function-Free Optimization with an Application to Neural Networks Training
Multilevel minimization for deep residual networks
Globally Convergent Multilevel Training of Deep Residual Networks
Finite basis physics-informed neural networks (FBPINNs): a scalable domain decomposition approach for solving differential equations
Finite basis physics-informed neural networks as a Schwarz domain decomposition method
Nonlinear Schwarz preconditioning for quasi-Newton methods
Nonlinear Schwarz preconditioning for nonlinear optimization problems with bound constraints
Decomposition and preconditioning of deep convolutional neural networks for training acceleration
Adaptive nonlinear elimination in nonlinear FETI-DP methods

This page was built for publication: Enhancing training of physics-informed neural networks using domain decomposition-based preconditioning strategies

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6623675)