Projection Methods for Operator Learning and Universal Approximation

📅 2024-06-18
🏛️ arXiv.org
📈 Citations: 2
Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses the universal approximation of continuous (including nonlinear) operators on Banach spaces. Methodologically, it introduces a novel learning framework based on orthogonal polynomial projections—marking the first integration of Leray–Schauder mapping theory into operator approximation theorems, synergizing Banach-space operator analysis with spectral approximation techniques in $L^p$ spaces. Specifically, in $L^p$ (notably $L^2$), it establishes a two-stage operator learning paradigm: “learnable projection” followed by “finite-dimensional mapping.” Theoretical contributions include: (1) a proof of universal approximation capability for the framework on arbitrary Banach spaces; (2) explicit sufficient conditions ensuring high-precision operator approximation in $L^2$; and (3) the first rigorous, unified mathematical foundation for operator neural networks.

Technology Category

Application Category

📝 Abstract
We obtain a new universal approximation theorem for continuous (possibly nonlinear) operators on arbitrary Banach spaces using the Leray-Schauder mapping. Moreover, we introduce and study a method for operator learning in Banach spaces $L^p$ of functions with multiple variables, based on orthogonal projections on polynomial bases. We derive a universal approximation result for operators where we learn a linear projection and a finite dimensional mapping under some additional assumptions. For the case of $p=2$, we give some sufficient conditions for the approximation results to hold. This article serves as the theoretical framework for a deep learning methodology in operator learning.
Problem

Research questions and friction points this paper is trying to address.

Universal approximation for nonlinear operators on Banach spaces
Operator learning via orthogonal projections on polynomial bases
Theoretical framework for deep learning in operator learning
Innovation

Methods, ideas, or system contributions that make the work stand out.

Uses Leray-Schauder mapping for universal approximation
Employs orthogonal projections on polynomial bases
Learns linear projection and finite dimensional mapping
🔎 Similar Papers
No similar papers found.
E
E. Zappala