Spatial Functional Deep Neural Network Model: A New Prediction Algorithm

2025-04-17

AI Summary

Accurate prediction of spatially dependent functional data remains challenging due to the joint complexity of spatial dependence and infinite-dimensional functional structures. Method: This paper proposes a novel nonlinear modeling framework that integrates spatial autoregressive (SAR) structure with functional deep neural networks. It innovatively embeds the SAR mechanism—first time in functional deep learning—and introduces a two-stage adaptive estimation strategy to jointly ensure interpretability of spatial parameters and high-fidelity nonlinear modeling of complex functional relationships. The method unifies functional data representation, SAR modeling, deep neural networks, and maximum likelihood estimation. Contribution/Results: Monte Carlo simulations confirm favorable statistical properties. In predicting COVID-19 mortality across Brazilian municipalities, the proposed method achieves significantly lower mean squared prediction error on the test set compared to leading benchmark models, demonstrating superior generalization capability and practical applicability for spatial functional forecasting.

Technology Category

• Machine Learning: Deep Generative Models & Autoencoders
• Reasoning under Uncertainty: Relational Probabilistic Models
• Planning, Routing, and Scheduling: Optimization of Spatio-temporal Systems

Application Category

• Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphs
• Search and Retrieval-Augmented AI: Web learning to rank, online learning, and counterfactual learning for ranking
• User Modeling, Personalization and Recommendation: Federated recommendation systems and personalization

Abstract

Accurate prediction of spatially dependent functional data is critical for various engineering and scientific applications. In this study, a spatial functional deep neural network model was developed with a novel non-linear modeling framework that seamlessly integrates spatial dependencies and functional predictors using deep learning techniques. The proposed model extends classical scalar-on-function regression by incorporating a spatial autoregressive component while leveraging functional deep neural networks to capture complex non-linear relationships. To ensure a robust estimation, the methodology employs an adaptive estimation approach, where the spatial dependence parameter was first inferred via maximum likelihood estimation, followed by non-linear functional regression using deep learning. The effectiveness of the proposed model was evaluated through extensive Monte Carlo simulations and an application to Brazilian COVID-19 data, where the goal was to predict the average daily number of deaths. Comparative analysis with maximum likelihood-based spatial functional linear regression and functional deep neural network models demonstrates that the proposed algorithm significantly improves predictive performance. The results for the Brazilian COVID-19 data showed that while all models achieved similar mean squared error values over the training modeling phase, the proposed model achieved the lowest mean squared prediction error in the testing phase, indicating superior generalization ability.

Problem

• Predict spatially dependent functional data accurately
• Integrate spatial dependencies with functional predictors
• Improve predictive performance over existing models

Innovation

• Integrates spatial dependencies with deep learning
• Uses adaptive estimation for robust modeling
• Improves predictive performance significantly