NObSP: Functional Decomposition of Neural Networks via Oblique Subspace Projections

📅 2026-09-15
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文提出NObSP方法,通过斜投影分解神经网络预测,解决深度神经网络决策解释问题,支持局部和全局功能分析。
📝 Abstract
Understanding how deep neural networks make decisions remains a fundamental challenge. We present NObSP (Nonlinear Oblique Subspace Projections), a framework that decomposes predictions into explicit per feature contribution functions and an interaction residual. NObSP exploits the linear final layer of a trained network and uses oblique projections in sample space to reduce double counting when learned feature subspaces overlap, thereby supporting both local explanations and global functional analysis. We establish connections to functional ANOVA and the Kolmogorov-Arnold representation theorem and derive an efficient partial regression algorithm for out of sample evaluation. For convolutional networks, NObSP-CAM produces class activation maps without backward passes after a one time calibration. Experiments on tabular and vision benchmarks show faithfulness comparable to established attribution methods. On a synthetic benchmark with known component functions, NObSP obtains a Function Reproduction Score of 0.989, compared with 0.966 for KernelSHAP and 0.922 for Integrated Gradients. On TinyImageNet, contribution vector embeddings improve mean nearest neighbor class purity from 0.654 for raw activations to 0.713 and reduce mean neighbor distance by more than half. These results indicate that NObSP complements scalar attribution methods by recovering functional contribution profiles with separable positive and negative evidence.
Problem

Research questions and friction points this paper is trying to address.

deep neural networks
decision making
functional decomposition
Innovation

Methods, ideas, or system contributions that make the work stand out.

Nonlinear Oblique Subspace Projections
Feature Contribution Decomposition
Convolutional Networks
Class Activation Maps
Functional Analysis
🔎 Similar Papers
A
Alexander Caicedo
Department of Electronic Engineering, Pontificia Universidad Javeriana, Bogotá, Colombia
V
Víctor De La Hoz
Pontificia Universidad Javeriana, Bogotá, Colombia
S
Santiago Alférez
Department of Mathematics, Universitat Politècnica de Catalunya, Barcelona, Spain