How Do Transformers Model Physics? Investigating the Simple Harmonic Oscillator

ow do transformers model physics? Do transformers model systems with interpretable analytical solutions or do they create an “alien physics” that is difficult for humans to decipher? We have taken a step towards demystifying this larger puzzle by investigating the simple harmonic oscillator (SHO), 𝑥...

Full description

Bibliographic Details
Main Authors: Kantamneni, Subhash, Liu, Ziming, Tegmark, Max
Other Authors: Massachusetts Institute of Technology. Department of Physics
Format: Article
Published: Multidisciplinary Digital Publishing Institute 2024
Online Access:https://hdl.handle.net/1721.1/157692