TILOS Seminar: Kinetic Theory Perspective of Foundation Models for Physics
Speaker: Maarten de Hoop, Rice University Abstract: We present a kinetic theory perspective of foundation models for physics. We begin with providing a mathematical framework for analyzing transformers. To uniformly address their expressivity, we consider the case that the mappings are conditioned on a context represented by a probability distribution of tokens. That is, transformers becomeContinue reading "TILOS Seminar: Kinetic Theory Perspective of Foundation Models for Physics"