Information Spreading in Diffusion Models from Effective Field Theory
Navonil Neogi, Nabil Iqbal
hep-th cond-mat.stat-mech cs.LG
Abstract
We study score-matching diffusion models with a convolutional architecture. We argue that the inductive bias of locality means that the machinery of effective field theory from physics can be usefully applied to describe the denoising dynamics. We apply this formalism first to a simple toy example which permits an analytical description, and thereafter to MNIST, and show that in both cases, the mutual information between two points grows in a manner predicted by a simple effective field theory of Brownian motion.
Topics
Classified with taxonomy v2 on Sat, 5 Sept 2026.