TY - JOUR
T1 - VW-PINNs
T2 - A volume weighting method for PDE residuals in physics-informed neural networks
AU - Song, Jiahao
AU - Cao, Wenbo
AU - Liao, Fei
AU - Zhang, Weiwei
N1 - Publisher Copyright:
© The Chinese Society of Theoretical and Applied Mechanics and Springer-Verlag GmbH Germany, part of Springer Nature 2024.
PY - 2025/3
Y1 - 2025/3
N2 - Physics-informed neural networks (PINNs) have shown remarkable prospects in solving the forward and inverse problems involving partial differential equations (PDEs). The method embeds PDEs into the neural network by calculating the PDE loss at a set of collocation points, providing advantages such as meshfree and more convenient adaptive sampling. However, when solving PDEs using nonuniform collocation points, PINNs still face challenge regarding inefficient convergence of PDE residuals or even failure. In this work, we first analyze the ill-conditioning of the PDE loss in PINNs under nonuniform collocation points. To address the issue, we define volume weighting residual and propose volume weighting physics-informed neural networks (VW-PINNs). Through weighting the PDE residuals by the volume that the collocation points occupy within the computational domain, we embed explicitly the distribution characteristics of collocation points in the loss evaluation. The fast and sufficient convergence of the PDE residuals for the problems involving nonuniform collocation points is guaranteed. Considering the meshfree characteristics of VW-PINNs, we also develop a volume approximation algorithm based on kernel density estimation to calculate the volume of the collocation points. We validate the universality of VW-PINNs by solving the forward problems involving flow over a circular cylinder and flow over the NACA0012 airfoil under different inflow conditions, where conventional PINNs fail. By solving the Burgers’ equation, we verify that VW-PINNs can enhance the efficiency of existing the adaptive sampling method in solving the forward problem by three times, and can reduce the relative L2 error of conventional PINNs in solving the inverse problem by more than one order of magnitude.
AB - Physics-informed neural networks (PINNs) have shown remarkable prospects in solving the forward and inverse problems involving partial differential equations (PDEs). The method embeds PDEs into the neural network by calculating the PDE loss at a set of collocation points, providing advantages such as meshfree and more convenient adaptive sampling. However, when solving PDEs using nonuniform collocation points, PINNs still face challenge regarding inefficient convergence of PDE residuals or even failure. In this work, we first analyze the ill-conditioning of the PDE loss in PINNs under nonuniform collocation points. To address the issue, we define volume weighting residual and propose volume weighting physics-informed neural networks (VW-PINNs). Through weighting the PDE residuals by the volume that the collocation points occupy within the computational domain, we embed explicitly the distribution characteristics of collocation points in the loss evaluation. The fast and sufficient convergence of the PDE residuals for the problems involving nonuniform collocation points is guaranteed. Considering the meshfree characteristics of VW-PINNs, we also develop a volume approximation algorithm based on kernel density estimation to calculate the volume of the collocation points. We validate the universality of VW-PINNs by solving the forward problems involving flow over a circular cylinder and flow over the NACA0012 airfoil under different inflow conditions, where conventional PINNs fail. By solving the Burgers’ equation, we verify that VW-PINNs can enhance the efficiency of existing the adaptive sampling method in solving the forward problem by three times, and can reduce the relative L2 error of conventional PINNs in solving the inverse problem by more than one order of magnitude.
KW - Deep learning
KW - Nonuniform sampling
KW - Partial differential equations
KW - Physics-informed neural networks
KW - Residual balancing
UR - http://www.scopus.com/inward/record.url?scp=85205422745&partnerID=8YFLogxK
U2 - 10.1007/s10409-024-24140-x
DO - 10.1007/s10409-024-24140-x
M3 - 文章
AN - SCOPUS:85205422745
SN - 0567-7718
VL - 41
JO - Acta Mechanica Sinica/Lixue Xuebao
JF - Acta Mechanica Sinica/Lixue Xuebao
IS - 3
M1 - 324140
ER -