Discovery of 2D Materials using Transformer Network‐Based Generative Design

Two‐dimensional (2D) materials offer great potential in various fields like superconductivity, quantum systems, and topological materials. However, designing them systematically remains challenging due to the limited pool of fewer than 100 experimentally synthesized 2D materials. Recent advancements...

Full description

Bibliographic Details
Main Authors: Rongzhi Dong, Yuqi Song, Edirisuriya M. D. Siriwardane, Jianjun Hu
Format: Article
Language:English
Published: Wiley 2023-12-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202300141
_version_ 1797378775550263296
author Rongzhi Dong
Yuqi Song
Edirisuriya M. D. Siriwardane
Jianjun Hu
author_facet Rongzhi Dong
Yuqi Song
Edirisuriya M. D. Siriwardane
Jianjun Hu
author_sort Rongzhi Dong
collection DOAJ
description Two‐dimensional (2D) materials offer great potential in various fields like superconductivity, quantum systems, and topological materials. However, designing them systematically remains challenging due to the limited pool of fewer than 100 experimentally synthesized 2D materials. Recent advancements in deep learning, data mining, and density functional theory (DFT) calculations have paved the way for exploring new 2D material candidates. Herein, a generative material design pipeline known as the material transformer generator (MTG) is proposed. MTG leverages two distinct 2D material composition generators, both trained using self‐learning neural language models rooted in transformers, with and without transfer learning. These models generate numerous potential 2D compositions, which are plugged into established templates for known 2D materials to predict their crystal structures. To ensure stability, DFT computations assess their thermodynamic stability based on energy‐above‐hull and formation energy metrics. MTG has found four new DFT‐validated stable 2D materials: NiCl4, IrSBr, CuBr3, and CoBrCl, all with zero energy‐above‐hull values that indicate thermodynamic stability. Additionally, GaBrO and NbBrCl3 are found with energy‐above‐hull values below 0.05 eV. CuBr3 and GaBrO exhibit dynamic stability, confirmed by phonon dispersion analysis. In summary, the MTG pipeline shows significant potential for discovering new 2D and functional materials.
first_indexed 2024-03-08T20:12:30Z
format Article
id doaj.art-d1bea25de4d84e5eb895cda8f1540f9a
institution Directory Open Access Journal
issn 2640-4567
language English
last_indexed 2024-03-08T20:12:30Z
publishDate 2023-12-01
publisher Wiley
record_format Article
series Advanced Intelligent Systems
spelling doaj.art-d1bea25de4d84e5eb895cda8f1540f9a2023-12-23T04:53:50ZengWileyAdvanced Intelligent Systems2640-45672023-12-01512n/an/a10.1002/aisy.202300141Discovery of 2D Materials using Transformer Network‐Based Generative DesignRongzhi Dong0Yuqi Song1Edirisuriya M. D. Siriwardane2Jianjun Hu3Department of Computer Science and Engineering University of South Carolina Columbia SC 29201 USADepartment of Computer Science and Engineering University of South Carolina Columbia SC 29201 USADepartment of Physics University of Colombo Colombo 00300 Sri LankaDepartment of Computer Science and Engineering University of South Carolina Columbia SC 29201 USATwo‐dimensional (2D) materials offer great potential in various fields like superconductivity, quantum systems, and topological materials. However, designing them systematically remains challenging due to the limited pool of fewer than 100 experimentally synthesized 2D materials. Recent advancements in deep learning, data mining, and density functional theory (DFT) calculations have paved the way for exploring new 2D material candidates. Herein, a generative material design pipeline known as the material transformer generator (MTG) is proposed. MTG leverages two distinct 2D material composition generators, both trained using self‐learning neural language models rooted in transformers, with and without transfer learning. These models generate numerous potential 2D compositions, which are plugged into established templates for known 2D materials to predict their crystal structures. To ensure stability, DFT computations assess their thermodynamic stability based on energy‐above‐hull and formation energy metrics. MTG has found four new DFT‐validated stable 2D materials: NiCl4, IrSBr, CuBr3, and CoBrCl, all with zero energy‐above‐hull values that indicate thermodynamic stability. Additionally, GaBrO and NbBrCl3 are found with energy‐above‐hull values below 0.05 eV. CuBr3 and GaBrO exhibit dynamic stability, confirmed by phonon dispersion analysis. In summary, the MTG pipeline shows significant potential for discovering new 2D and functional materials.https://doi.org/10.1002/aisy.202300141crystal structure predictiondeep learningtransformer neural networksmaterials discovery2D materialstransformer-based materials generators
spellingShingle Rongzhi Dong
Yuqi Song
Edirisuriya M. D. Siriwardane
Jianjun Hu
Discovery of 2D Materials using Transformer Network‐Based Generative Design
Advanced Intelligent Systems
crystal structure prediction
deep learning
transformer neural networks
materials discovery
2D materials
transformer-based materials generators
title Discovery of 2D Materials using Transformer Network‐Based Generative Design
title_full Discovery of 2D Materials using Transformer Network‐Based Generative Design
title_fullStr Discovery of 2D Materials using Transformer Network‐Based Generative Design
title_full_unstemmed Discovery of 2D Materials using Transformer Network‐Based Generative Design
title_short Discovery of 2D Materials using Transformer Network‐Based Generative Design
title_sort discovery of 2d materials using transformer network based generative design
topic crystal structure prediction
deep learning
transformer neural networks
materials discovery
2D materials
transformer-based materials generators
url https://doi.org/10.1002/aisy.202300141
work_keys_str_mv AT rongzhidong discoveryof2dmaterialsusingtransformernetworkbasedgenerativedesign
AT yuqisong discoveryof2dmaterialsusingtransformernetworkbasedgenerativedesign
AT edirisuriyamdsiriwardane discoveryof2dmaterialsusingtransformernetworkbasedgenerativedesign
AT jianjunhu discoveryof2dmaterialsusingtransformernetworkbasedgenerativedesign