Elliptic PDE learning is provably data-efficient

Proc Natl Acad Sci U S A. 2023 Sep 26;120(39):e2303904120. doi: 10.1073/pnas.2303904120. Epub 2023 Sep 18.

Abstract

Partial differential equations (PDE) learning is an emerging field that combines physics and machine learning to recover unknown physical systems from experimental data. While deep learning models traditionally require copious amounts of training data, recent PDE learning techniques achieve spectacular results with limited data availability. Still, these results are empirical. Our work provides theoretical guarantees on the number of input-output training pairs required in PDE learning. Specifically, we exploit randomized numerical linear algebra and PDE theory to derive a provably data-efficient algorithm that recovers solution operators of three-dimensional uniformly elliptic PDEs from input-output data and achieves an exponential convergence rate of the error with respect to the size of the training dataset with an exceptionally high probability of success.

Keywords: deep learning; inverse problems; neural operators; sample complexity.