Neural Symbollic Regression Using Deep Learning and Sparse Modelling

📅 2026-09-01
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出了一种神经符号回归框架,通过深度学习和稀疏建模方法解决传统符号回归的可扩展性和噪声敏感问题。
📝 Abstract
Symbolic Regression (SR) seeks to find succinct mathematical expressions that represent the fundamental relationships within data, providing interpretability and scientific understanding that exceeds that of black-box models. Nevertheless, traditional methods like Genetic Programming face challenges with scalability and are highly sensitive to noise, while sparse regression techniques such as SINDy rely significantly on predetermined feature libraries. In this work, we present a Neural Symbolic Regression (NSR) framework that treats neural networks as functional preconditioners for symbolic discovery. Our approach uses a decoupled pipeline: a neural network first learns a smooth, noise-robust approximation of the target function in an interaction- aware nonlinear feature space. LASSO is then applied to extract sparse, interpretable closed-form expressions. To improve predictive accuracy and symbolic fidelity by integrating distributed hyperparameter optimization with Ray Tune and ASHA scheduling. Experiments on the Nguyen benchmark suite show that our approach consistently outperforms SINDy and non-tuned neural baselines in RMSE, noise robustness, and out-of-distribution generalization. Ablation studies confirm the significance of feature interactions, neural depth, and tuning strategies. In general, this study presents a scalable and understandable neural-symbolic framework, creating a solid link between neural approximation and the discovery of sparse equations for scientific machine learning.
Problem

Research questions and friction points this paper is trying to address.

Symbolic Regression
Scalability
Noise Sensitivity
Sparse Regression
Feature Libraries
Innovation

Methods, ideas, or system contributions that make the work stand out.

Neural Symbolic Regression
Functional Preconditioner
Interaction-aware Nonlinear Feature Space
LASSO
Distributed Hyperparameter Optimization
🔎 Similar Papers
No similar papers found.
R
Ravi Kumar U
Department of Mathematics, Indian Institute of Space Science and Technology, Thiruvananthapuram, India
S
Sumitra S
Department of Mathematics, Indian Institute of Space Science and Technology, Thiruvananthapuram, India