Physics-informed neural networks with non-differentiable loss
Physics-informed Neural Networks (PINN) are special neural networks that are designed for scientific computing tasks. Recent research has found its promising capability to integrate any given law of physics in different forms including general nonlinear partial differentiable equations. It has sh...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/158021 |
| _version_ | 1811687064726405120 |
|---|---|
| author | Yang, Junyan |
| author2 | Mao Kezhi |
| author_facet | Mao Kezhi Yang, Junyan |
| author_sort | Yang, Junyan |
| collection | NTU |
| description | Physics-informed Neural Networks (PINN) are special neural networks that are designed
for scientific computing tasks. Recent research has found its promising capability to integrate
any given law of physics in different forms including general nonlinear partial differentiable
equations. It has shown great potential to function as a data-efficient universal function
approximator that is able to encode any underlying physical laws as prior information.
However, just like other ordinary neural networks, the usage of such knowledge still relies
on the optimization of neural networks which implies that a differentiable loss function is
indispensable. Yet sometimes human knowledge contradict such requirement and knowledge,
such as qualitative conclusions, can not be constructed into PINN directly. After a delicate
literature review, the surrogate model was chosen as a better fit to substitute the original loss
function, which can reconstruct a continuous and differentiable function from samples from
the original function. We then propose the PINN with surrogate loss (SL-PINN). It greatly
boosts the performance when integrating human knowledge into the neural network |
| first_indexed | 2024-10-01T05:10:22Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/158021 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:10:22Z |
| publishDate | 2022 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1580212023-07-07T19:26:53Z Physics-informed neural networks with non-differentiable loss Yang, Junyan Mao Kezhi School of Electrical and Electronic Engineering A*STAR Institute of High Performance Computing EKZMao@ntu.edu.sg Engineering::Computer science and engineering Physics-informed Neural Networks (PINN) are special neural networks that are designed for scientific computing tasks. Recent research has found its promising capability to integrate any given law of physics in different forms including general nonlinear partial differentiable equations. It has shown great potential to function as a data-efficient universal function approximator that is able to encode any underlying physical laws as prior information. However, just like other ordinary neural networks, the usage of such knowledge still relies on the optimization of neural networks which implies that a differentiable loss function is indispensable. Yet sometimes human knowledge contradict such requirement and knowledge, such as qualitative conclusions, can not be constructed into PINN directly. After a delicate literature review, the surrogate model was chosen as a better fit to substitute the original loss function, which can reconstruct a continuous and differentiable function from samples from the original function. We then propose the PINN with surrogate loss (SL-PINN). It greatly boosts the performance when integrating human knowledge into the neural network Bachelor of Engineering (Electrical and Electronic Engineering) 2022-05-27T00:40:49Z 2022-05-27T00:40:49Z 2022 Final Year Project (FYP) Yang, J. (2022). Physics-informed neural networks with non-differentiable loss. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/158021 https://hdl.handle.net/10356/158021 en B1099-211 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering Yang, Junyan Physics-informed neural networks with non-differentiable loss |
| title | Physics-informed neural networks with non-differentiable loss |
| title_full | Physics-informed neural networks with non-differentiable loss |
| title_fullStr | Physics-informed neural networks with non-differentiable loss |
| title_full_unstemmed | Physics-informed neural networks with non-differentiable loss |
| title_short | Physics-informed neural networks with non-differentiable loss |
| title_sort | physics informed neural networks with non differentiable loss |
| topic | Engineering::Computer science and engineering |
| url | https://hdl.handle.net/10356/158021 |
| work_keys_str_mv | AT yangjunyan physicsinformedneuralnetworkswithnondifferentiableloss |