Publications

Attention is all you need to solve chiral superconductivity

Chun-Tse Li, Tzen Ong, Max Geier, Hsin Lin, Liang Fu

Recent advances on neural quantum states have shown that correlations between quantum particles can be efficiently captured by attention-- a foundation of modern neural architectures that enables neural networks to learn the relation between objects. In this work, we show that a general-purpose self-attention Fermi neural network is able to find chiral px±ipy superconductivity in an attractive Fermi gas by energy minimization, {\it without prior knowledge or bias towards pairing}. The superconducting state is identified from the optimized wavefunction by measuring various physical observables: the pair binding energy, the total angular momentum of the ground state, and off-diagonal long-range order in the two-body reduced density matrix. Our work paves the way for AI-driven discovery of unconventional and topological superconductivity in strongly correlated quantum materials.

Read more

Artificial Intelligence for Quantum Matter: Finding a Needle in a Haystack

Khachatur Nazaryan, Filippo Gaggioli, Yi Teng, Liang Fu

Neural networks (NNs) have great potential in solving the ground state of various many-bodyproblems. However, several key challenges remain to be overcome before NNs can tackle problemsand system sizes inaccessible with more established tools. Here, we present a general and efficientmethod for learning the NN representation of an arbitrary many-body complex wave function fromits N-particle probability density and probability current density. Having reached overlaps as largeas 99.9%, we employ our neural wave function for pre-training to effortlessly solve the fractionalquantum Hall problem with Coulomb interactions and realistic Landau-level mixing for as manyas 25 particles. Our work demonstrates efficient, accurate simulation of highly-entangled quantummatter using general-purpose deep NNs enhanced with physics-informed initialization.

Read more

Is attention all you need to solve the correlated electron problem?

Max Geier, Khachatur Nazaryan, Timothy Zaklama, Liang Fu

The attention mechanism has transformed artificial intelligence research by its ability to learn relations between objects. In this work, we explore how a many-body wavefunction ansatz constructed from a large-parameter self-attention neural network can be used to solve the interacting electron problem in solids. By a systematic neural-network variational Monte Carlo study on a moiré quantum material, we demonstrate that the self-attention ansatz provides an accurate and efficient solution without human bias. Moreover, our numerical study finds that the required number of variational parameters scales roughly as N2 with the number of electrons, which opens a path towards efficient large-scale simulations.

Read more

Solving fractional electron states in twisted MoTe2 with deep neural network

Di Luo, Timothy Zaklama, Liang Fu

The emergence of moiré materials, such as twisted transition-metal dichalcogenides (TMDs), has created a fertile ground for discovering novel quantum phases of matter. However, solving many-electron problems in moiré systems presents significant challenges due to strong electron correlation and strong moiré band mixing. Recent advancements in neural quantum states hold the promise for accurate and unbiased variational solutions. Here, we introduce a powerful neural wavefunction to solve ground states of twisted MoTe2 across various fractional fillings, reaching unprecedented accuracy and system size. From the full structure factor and quantum weight, we conclude that our neural wavefunction accurately captures both the electron crystal at ν=1/3 and various fractional quantum liquids in a unified manner.

Read more

Solving the fractional quantum Hall problem with self-attention neural network

Yi Teng, David D. Dai, Liang Fu

We introduce an attention-based fermionic neural network (FNN) to variationally solve the problem of two-dimensional Coulomb electron gas in magnetic fields, a canonical platform for fractional quantum Hall (FQH) liquids, Wigner crystals, and other unconventional electron states. Working directly with the full Hilbert space of 𝑁 electrons confined to a disk, our FNN consistently attains energies lower than LL-projected exact diagonalization (ED) and learns the ground state wave function to high accuracy. In low LL mixing regime, our FNN reveals microscopic features in the short-distance behavior of FQH wave function beyond the Laughlin ansatz. For moderate and strong LL mixing parameters, the FNN outperforms ED significantly. Moreover, a phase transition from FQH liquid to a crystal state is found at strong LL mixing. Our study demonstrates unprecedented power and universality of FNN based variational method for solving strong-coupling many-body problems with topological order and electron fractionalization.

Read more