Higher Structures in Deep Learning

2026-08-31

AI Summary

研究通过引入高阶张量操作和超图广义多层感知机，探索了深度学习中高阶现象，并与进化算法联系起来。

Abstract

We provide an expository introduction on the importance of higher-arity tensor operations to deep learning. Then, we conduct a novel empirical investigation of higher-arity phenomenon in trained neural networks, introduce a hypergraphical generalization of the multilayer perceptron, and explore connections to evolutionary algorithms. We conclude with a discussion of promising directions for future research.

Problem

• higher-arity tensor operations
• deep learning
• trained neural networks

Innovation

• higher-arity tensor operations
• hypergraphical generalization
• evolutionary algorithms