Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification
Neural network interatomic potentials (NNIPs) are a significant advancement in computational materials science and chemistry for their ability to accurately approximate the potential energy surface (PES) of atomic systems with significantly reduced computational costs compared to quantum mechanical...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2024
|
| Online Access: | https://hdl.handle.net/1721.1/155357 https://orcid.org/0000-0001-6731-5531 |
| _version_ | 1826192314539704320 |
|---|---|
| author | Tan, Aik Rui |
| author2 | Gómez-Bombarelli, Rafael |
| author_facet | Gómez-Bombarelli, Rafael Tan, Aik Rui |
| author_sort | Tan, Aik Rui |
| collection | MIT |
| description | Neural network interatomic potentials (NNIPs) are a significant advancement in computational materials science and chemistry for their ability to accurately approximate the potential energy surface (PES) of atomic systems with significantly reduced computational costs compared to quantum mechanical methods. Without relying on predefined interaction parameters, NNIPs offers greater flexibility and adaptability than classical force fields, and can be used for atomistic simulations of complex materials and biological systems. However, NNIPs face inherent limitations due to their dependence on diverse training data and limited extrapolative capabilities. This thesis proposes methodologies to address these challenges through analysis of uncertainty quantification (UQ) techniques, introduction of novel data sampling strategies, and development of structural similarity analysis algorithm to extract physical insights from diverse data sets. First, we examine the efficacy of UQ for single deterministic neural networks, demonstrating that a Gaussian mixture model-based approach can significantly reduce computational demands without sacrificing prediction accuracy and UQ reliability, although it does not significantly outperform the baseline ensemble method. Utilizing insights gained from the UQ analysis, we introduce a PES sampling technique based on adversarial attacks on predicted uncertainties, which samples atomic configurations with maximized uncertainties and mitigates the typical correlation issues associated with molecular dynamics sampling. Additionally, recognizing the limitations of the proposed adversarial sampling method, we introduce an enhanced sampling method using predicted uncertainty as collective variables (CVs) to enable more thorough exploration of under-sampled regions and to reduce confinement within local minima/maxima of energy and uncertainty landscapes. Finally, we propose a graph-based method to analyze structural variances in amorphous bulk systems that could be difficult to capture using conventional CVs, and yet can provide physical insights to explain the macroscopic properties of the materials. Overall, the methodologies proposed in this thesis improve the robustness and applicability of NNIPs in atomistic simulations and provide a groundwork for further advancements in this space. |
| first_indexed | 2024-09-23T09:09:15Z |
| format | Thesis |
| id | mit-1721.1/155357 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T09:09:15Z |
| publishDate | 2024 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1553572024-06-28T03:54:53Z Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification Tan, Aik Rui Gómez-Bombarelli, Rafael Massachusetts Institute of Technology. Department of Materials Science and Engineering Neural network interatomic potentials (NNIPs) are a significant advancement in computational materials science and chemistry for their ability to accurately approximate the potential energy surface (PES) of atomic systems with significantly reduced computational costs compared to quantum mechanical methods. Without relying on predefined interaction parameters, NNIPs offers greater flexibility and adaptability than classical force fields, and can be used for atomistic simulations of complex materials and biological systems. However, NNIPs face inherent limitations due to their dependence on diverse training data and limited extrapolative capabilities. This thesis proposes methodologies to address these challenges through analysis of uncertainty quantification (UQ) techniques, introduction of novel data sampling strategies, and development of structural similarity analysis algorithm to extract physical insights from diverse data sets. First, we examine the efficacy of UQ for single deterministic neural networks, demonstrating that a Gaussian mixture model-based approach can significantly reduce computational demands without sacrificing prediction accuracy and UQ reliability, although it does not significantly outperform the baseline ensemble method. Utilizing insights gained from the UQ analysis, we introduce a PES sampling technique based on adversarial attacks on predicted uncertainties, which samples atomic configurations with maximized uncertainties and mitigates the typical correlation issues associated with molecular dynamics sampling. Additionally, recognizing the limitations of the proposed adversarial sampling method, we introduce an enhanced sampling method using predicted uncertainty as collective variables (CVs) to enable more thorough exploration of under-sampled regions and to reduce confinement within local minima/maxima of energy and uncertainty landscapes. Finally, we propose a graph-based method to analyze structural variances in amorphous bulk systems that could be difficult to capture using conventional CVs, and yet can provide physical insights to explain the macroscopic properties of the materials. Overall, the methodologies proposed in this thesis improve the robustness and applicability of NNIPs in atomistic simulations and provide a groundwork for further advancements in this space. Ph.D. 2024-06-27T19:47:28Z 2024-06-27T19:47:28Z 2024-05 2024-05-10T18:31:55.550Z Thesis https://hdl.handle.net/1721.1/155357 https://orcid.org/0000-0001-6731-5531 Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) Copyright retained by author(s) https://creativecommons.org/licenses/by-nc-nd/4.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Tan, Aik Rui Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification |
| title | Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification |
| title_full | Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification |
| title_fullStr | Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification |
| title_full_unstemmed | Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification |
| title_short | Enhancing Robustness of Neural Network Interatomic Potentials through Sampling Methods and Uncertainty Quantification |
| title_sort | enhancing robustness of neural network interatomic potentials through sampling methods and uncertainty quantification |
| url | https://hdl.handle.net/1721.1/155357 https://orcid.org/0000-0001-6731-5531 |
| work_keys_str_mv | AT tanaikrui enhancingrobustnessofneuralnetworkinteratomicpotentialsthroughsamplingmethodsanduncertaintyquantification |