Adaptive transfer learning for PINN | |
Liu Y(刘洋)![]() ![]() ![]() | |
Source Publication | Journal of Computational Physics
![]() |
2023-10-01 | |
Volume | 490Pages:1 - 29 |
Abstract | Physics-informed neural networks (PINNs) have shown great potential in solving computational physics problems with sparse, noisy, unstructured, and multi-fidelity data. However, the training of PINN remains a challenge, and PINN is not robust to deal with some complex problems, such as the sharp local gradient in broad computational domains, etc. Transfer learning techniques can provide fast and accurate training for PINN through intelligent initialization, but the previous researches are much less effective when dealing with transfer learning cases with a large range of parameter variation, which also suffers from the same drawbacks. This manuscript develops the concept of the minimum energy path for PINN and proposes an adaptive transfer learning for PINN (AtPINN). The Partial Differential Equations (PDEs) parameters are initialized by the source parameters and updated adaptively to the target parameters during the training process, which can guide the optimization of PINN from the source to the target task. This process is essentially performed along a designed low-loss path, which is no barrier in the energy landscape of neural networks. Consequently, the stability of the training process is guaranteed. AtPINN is utilized to achieve transfer learning cases with a large range of parameter variation for solving five complex problems. The results demonstrate that AtPINN has promising potential for extending the application of PINN. Besides, three transfer learning cases with different ranges of parameter variation are analyzed through visualization. Furthermore, results also show that the idea of adaptive transfer learning can be a particular optimization strategy to directly solve problems without intelligent initialization. |
DOI | 10.1016/j.jcp.2023.112291 |
Indexed By | SCI ; EI |
Language | 英语 |
WOS ID | WOS:001034874100001 |
Classification | 一类/力学重要期刊 |
Ranking | 1 |
Citation statistics | |
Document Type | 期刊论文 |
Identifier | http://dspace.imech.ac.cn/handle/311007/92516 |
Collection | 高温气体动力学国家重点实验室 宽域飞行工程科学与应用中心 |
Corresponding Author | Liu W(刘文) |
Affiliation | State Key Laboratory of High Temperature Gas Dynamics, Institute of Mechanics, Chinese Academy of Sciences, Beijing 100190, China |
Recommended Citation GB/T 7714 | Liu Y,Liu W,Yan XS,et al. Adaptive transfer learning for PINN[J]. Journal of Computational Physics,2023,490:1 - 29. |
APA | Liu Y,Liu W,Yan XS,Guo SQ,&Zhang CA.(2023).Adaptive transfer learning for PINN.Journal of Computational Physics,490,1 - 29. |
MLA | Liu Y,et al."Adaptive transfer learning for PINN".Journal of Computational Physics 490(2023):1 - 29. |
Files in This Item: | ||||||
File Name/Size | DocType | Version | Access | License | ||
Jp2023Fa164.pdf(5571KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | View Application Full Text |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment